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The approach taken in this project was a parallel development of intel- y 
ligence production models and a cognitive model of intelligence analysis. The AY 
Imagery Intelligence (IMINT) Production Model 
developed under this project and an existing Signals Intelligence (SIGINT) pro- 
duction model were used as the basis for developing a generic model of intel- 
ligence production, described in this Overview. The generic production model 
includes a description of the hierarchical f‘ow of intelligence data, aera 
etc., as well as a listiug of critical variables influencing analysis. 
detailed review of the psychological literature described in pert Alder AptAcé bes j 
i Report 445,>combined with the production models, led to development of a de- 
scriptive model of cognitive processes described in this Overview. This over- 
view also explores some of the implications of the cognitive model for training 
developments, system development, and organizational cc trol of intelligence 


production. The cognitive model will be extended and these implications will 
be examined in greater detail during Phase II of this project. 


FE 
5 
| 
\ 
k 
; 
B 
, 
bs 


; 
\ 
t 
bs 
b 
Hy 
i 
i 
t 
b 
k 







DDC Tag 


a 
Justiricg tion 





By 






Distri s 
Eh but ions 


—Availanidity oa. | 

e j | Hi 

Avail andjon an : 
Bpecial 


Unclassified 


{ 

a a : 

7 [ SECURITY CLASSIFICATION OF THIS PAGE(When Dete Entered) ; 
. 4 
j 

4 

4 





Research Repert 1237 





HUMAN PROCESSES IN INTELLIGENCE ANALYSIS: 
PHASE | OVERVIEW | 


Pe + ere rom om 


Robert V. Katter 
: Christine a. Montgomery 
i John R. Thompson 
Operating Systems, Inc. 


Submitted by: 
Edger M. Johnson, Chief 
HUMAN FACTORS TECHNICAL AREA 





Approved By: 
James D. Baker, Acting Director “ 
ORGANIZATIONS AND SYSTEMS ; | 
RESEARCH LABORATORY 


U.S. ARMY RESEARCH INSTITUTE FOR THE BEHAVIORAL AND SOCIAL SCIENCES 
5001 Eisenhower Avenue, Alexandria, Virginia 22333: 


Office, Deputy Chief of Staff for Personne! 
Department of the Army 


December 1979 


BR EAT EEA A FE CES SAE LT LS SE LE TE A EE ANTE ORT ETE TE SELENE TLE ATE ELLIE EDI 
eS : Intelligence Systems 
‘iu - 


Aeproved for public release; cletribution unlimited. 


114 


00 rice eps g tremt erin, ee 







. 5 a pe A a Il 
eet cha SARACEN MARIS pgiaretn tena) Hse 





UEGSETOEA A) ASUS, 3 a areernooe , ririenitida leitch sini asic? 


ree . ee ON TN 


ARI Research Reports and Technical Reports are intended for sponsors of 
R&O tasks and for other research and military agencies. Any findings ready 
for implementation at tie time of rublication are presenced in the last part 
of the Brief. Upon cornpietion of s major phase of the task, formal recom- 
mendations for official action normally are conveyed to appropriate military 
agencies *y briafing or Disposition Form. 











TE OTR RE ROR Oe ER NEE” ETF 


RR STE TR nore 





} 
i 
{ 
| 
| 
I 
| 


i 
; 
y 
t 
‘ 
: 
‘ 
; 1 
i 
: : 
‘ \ 
: . 
j j 
i \ 
f 4 
i i 
! fi 
: i 
} i 
: 1 
i 4 
t 1 
4 


iv 











Sg eg ee ew Wee ee ne Pr i ea a 
ete coe ear on gee pane ee , 

OTST ger reer ge ec pat 

. cee 8 I SE TE EE AR A Ae REY eSNG EE = 


2 te 





FOREWORD 





Intelligence collection systems have proliferated over the past several 
years, increasing in complexity and in volume of output. However, there has 
been no corresponding improvement in the ability of intelligence personnel to 
analyze this flood of data. US Army Intelligence and Security Commaad (INSCOM) : 
studies and Army Research Institute (ARI) research indicate that improved support F 
to and training of analysta are necessary to effectively utilize the increased 
collection capability and satisfy increasing demanda for intelligence within 
current personnel constraints. INSCOM end ARI therefore initiated a joint research 
program to provide improved support to the intelligence analyst. During early 
a discusaions of the issues, it became clear that any procedural, training, organi- 

* zaticnal, or system changes to support analysis will be effective only if based 
upon a detailed understanding of the analysts' role, methods, and thought processes 
in intelligence production. The first need was to evaluate and describe the human 
i analytic processes underlying intelligence analysis, synthesis, and production. 
This report provides an overview of the results of this research. 
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The approach taken in this project was to examine the role and activities 

of various types of intelligence anglysts, and to develop a descriptive model 
; of the cognitive processes involved in analysis. This model derives in large 
part from current psychological literature and does not provide a new statement 
of psychological principles. However, these principles are put in a new context, 
intelligence anaiysis. This report describes the generalized intelligence produc- 
tion model and the cognitive model. Separate reports describe in detail a model .—_,, 
of the production of imagery intelligence (ARI Research Report 1210)-and the %° we 
psychological literature underlying the cognitive model (ARI Technical Report 445)., - | 
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The research was accomplished by a government-contractor team under contract 
MDA 903-78-C-2044 and was monitored jointly by INSCOM and ARI. Continuous inter- 
action and collaboration of personnel from Operating Systems, Inc., INSCOM, and 
ARI insured a multidisciplinary approach to this research. 


This report and the others from this project provide a framework for detailed 
examination of training support and system support requirements in intelligence 
analyeis. These reports should be very useful during the development or evalua-~ 
tion of training procedures or materials, aralytic procedures, doctrine, and 
system requirements for automated support to analysts. 
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Human Process¢o in Intelligence Analysis: Phase I Overview 


BRIE? 





Requirement: 


To develop a framework for describing and understanding the process of 
intelligence analysis es performed by analysts working with either single- 
source or multi-source data. 


Approach: 


A series of structured interviews was conducted with both national and 
strategic level intelligence personnel experienced in signal, imagery, and 
all-source intelligence processing and production. Interviews with devel- 
opers oi training materials and observation of classroom instruction and 
field exercises provided additional information on individual and group 
responsibilities. Data obtained from interviews and observations were 
supplemented with documentation and reports based on INSCOM and ARI research. 
At the same time the research literature on cognitive information processing 
was reviewed. A descriptive model of the cognitive processes underlying 
intelligence analysis was developed baced on the general principles derived 
from the literature review and the interviews with intelligence personnel. 


Product: 


The examination of intelligence analysis identified enviromental and 
individual variables as well as underlying cognitive processes which con- 
tribute to the quality of intelligence. The model describing the cognitive 
processes of intelligence analysis is expected to serve as a descriptive 
framework for understanding all levels and disciplines of intelligence 
analysis. One of the main findings is that intelligence analysis ia an 
internal, concept-driven activity rether than an external, cata-driven 
activity. The presert report is an overview of the project, including the 
cognitive model. A process model of imagery intelligence and a detailed 
literature review have been published as separate reports. 


The findings and descriptive cognitive model could potentially contrib- 
ute to the improvement of the quality of intelligence products by providing 
a better understanding of the thinking, analyzing, and memory processes of 
intelligence personnel. The model can be used to study management and 
system functions as well as to guide future training and system develop-~ 
mits. The results will be incorporated in the development of functional 
8, :cifications for the All Source Analysis System. 
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ABSTRACT 


A project was undertaken to construct a general deacriptive model of the 
cognitive activities (mental processes) undertying the activities of Intelll- 
gence analysis. The approach used to devealap the cognitive model com- 
bined availeble Information on the way In which intelligence analysis is 
performed In actual work settings with availahle resnarch Jindings In cog- 
nitive psychology. The first step was to investigate analytical processing 
6s currently practiced in two types of single-source analysis, and subse- 
quently to generalize to muiti-source analysis. The initial interview and 
observation field study investigated signal intelligence (SIGINT). A second 
fleid study investigated imagery intelligence (IMINT) and resulted in a 
modal of the directly observable activities of single-source MINT produc- 
tion. A questionnaire interview guide was developed and used In deeper 
study of the two single-source disciplines and muflti-source production 
activities. A concomitant task reviewed literature from cognitive psychol- 
ogy for applicability to the study. A cognitive model was developed, and 
Intelligence analysis activities were studied from the point of view of the 
model. A main finding is that effective intelligence anatyals is a concept- 
driven activity rather than a data-driven one. Preject results have Impll- 
cations for improvements in a number of areas of intelligence work. 
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1. INTRODUCTION AND OVERVIEW report [ Imagery Intelligence (/MINT) 








1.1 Basic Objectives 


The study entitied Investigation of 
Methodologies and Techniques for intel- 
gence Analysis (IMTIA) has been almed 
at constructing a model of the cognitive 
processes underlying intelligence 
analysis activities. The present report 
provides a management overview of the 
project and its results. Another report 
jsee Cognitive Processes In Intelli- 
gence Anelysis: A Descriptive Model 
and Review of the Literature ] provides 
an expanded version of Section 6 of 
the present report, discussing the 
technical iiterature basis for the cogni- 
tive model in terms of Interest to social 
solc tista and technicians. A_ third 
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Production Model }] was produced by 
the IMTIA project. Publications used in 
the project are Included in the refer- 
ences. 


The IMTIA project aima to improve 
understanding of the cognitive activi- 
ties underlying intelligence processing 
and production. While the Intelligence 
cycle and associated activities are 
reasonably well-defined and under- 
stood, the activities that go on in the 
head of an intelligence analyst are not. 
These internal activities have been 
mainty a ‘black box’, where only inputs 
and outputs can be observed and 
described, and the unobservable 
processes Internal to the black box are 
unknown. The IMTIA project Is directed 
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at filling this void in tho overall under- 
standing of intelligence processing and 
production. The basic objective of the 
study was to develop a cognitive model 
that would provide a framework for the 
description of the mental processes 
used In intelligence anaiysais. 


1.2 Overview of Topics 


Section 1 summarizes the development 
approach for the model and outiines the 
main results and conclusions. Section 2 
through 6 are based on interviews and 


observations in the field. Section 2. 


describes the organizational structure 
of the intelligence cycle and treats 
Information flow within that framework. 
Section 3 presents a generic model for 
single-source and multi-source inteitl- 
gence producticn, Jescribes the core 
information processing functions of 
resource management, adaptation, and 
interpretation, and outlines task 
processes conmen to intelligence 
analysis. Sections 4 and 6& describe 
environmental and individual variables 
that affect intelligence anatysis activi- 
ties. 


Section 6 presents the cognitive model 
developed in the course of the study. 
The model is synthesized from a review 
of recent cognitive psychology litera- 
ture. This major section describes the 
structure of cognitive capacities, the 
basic dynamic cognitive processes, and 
the cyclic modification of memory con- 
tents. Section 7 describes aspects of 
anatytic work in the light of the cogni- 
tive medel, and is based on field obser- 
vations made from thd paint of view of 
the cognitive model es it was 
developed. The final section of the 
report, Section 8, presents implications 
of the cognitive model for a number of 
areas. These include: improving the 
accuracy and quality of analytic pro- 
ducts; improving the management of 


intelligence analysis and the formulation 
of operating policies and procedures; 
Providing criteria for the development 
and evaluation of advanced system 
designs in support of intelligence 
anatysts; Providing criteria for improving 
system arrangements for pe*formance — 
feecback; Facilitating efforts to 
develop and evalucte training programs 
and training doctrine; and, Providing 
assistance in personnel selection, 
motivation, end career planning. 


1.3 What ts Intelligence Anaiysis? 


The definition of intelligence ana'ysis 
presented in the Glossary of intelli- 
gence Terms and Definitions [sea 
references} reads as follows: “A pro- 
cess in the production step of the 
intelligence cycle in which intelli- 
gence information is subjected to 
systematic examination in order to 
identify significant facts ard derive 
conclusions therefrom." 


The problem with this definition is that 
the terms, when used to describe 
processes Inside the "black box", have 
no frame of reference: What does 
"systematic" mean? What are the sub- 
processes in “examination®"? What 


about "Identification"? “significant"? 


"facts"? “derive"? "conclusions"? 
Although the cognitive model now pro- 
vides a framework for answering these 
questions, no such model! existed at the 
putset of this study. 


In order to pursue this research, 
several operating definitions were 
adopted. A basic definition was that 
intelligence analysis is what intelli- 
gence analysts do -- an understanding 
of the processes of intelligence 
analysis and the cognit.ve processes 
underlying them must cume from the 
analysts themselves, from observing 
what they do and asking them about 
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A subsidiary definition was that the 
performance of analytical and judgmen- 
tal activities Invoiving complex cogni- 
tive processes is not limited to person- 
nel traditionally catied “anatysts." 
Rather -- for the purposes of this study 
-- Intelligence analysis was defined to 
include a spectrum of analytical and 
judgmental activities involved in the 
processing and production of intelli- 
gence, where individuals assigned to 
particular rcies in this process may 
spend more or less time in analytical 
activity depending on their assigned 
roles. : 


For example, signal intelligence (SIGINT) 
voice intercept operators clearty per- 
form some analytical activity in search- 
ing the signal environmert; however, 
much of their duty time is devoted to 
rather rigidly specified collection activi- 
ties, involving a minimum of anatytical ur 
judgmental processing. On the othe: 
hand, image interpreters  (IMINT 
analysts) in a national strategic facility 
are more continuously involved in 
analytical activity In searching Imagery 
and must deal with more complex data 
patterns. In contrast to SIGINT and 
iMINT specialists, multi-source analysts 
devote the largest proportion of thelr 
time to anatytical activity and deal with 
complex data patterns representing 
aggregations of single-source data. 


1.4 The Core Processes of intelli- 
gence Analysis 


Two assumptions about intelligence 
analysis underiie this research: 


1. First, it was assumed that a sot of 
common analytical task processes 
exists that crosscuts the various 
intelligence disciplines such as 
SIGINT, IMINT, and HUMINT (intelli- 
gence from human sources). These 
common analytical task processes 
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suppcrt core information process- 
ing functions for intelligence 
analysis. 


2. Second, it was assumed that tha 
identification of these common 
analytical task processes was 4 
key to identifying the core Infor- 
mation processing functions cf 
most importance to intelligence 
analysis. This was viewed as an 
important step in developing a cog- 
nitive model that could provide an 
especially productive framework for 
describing intelligence analysis. 


1.6 Study Approach 


The approach to identifying the set of 
common analytical task processes and 
developing a generic cognitive model 
based on these was first to investigate 
analytical processing as currently prac- 
ticed in two types of single-source 
analysis, and then to generalize the 
findings to the multi-source analysis 


_ environment where possible. As shown 


In Figure 1-1, the assumpticns dis- 
cussed above and the initial concepts 
regarding the nature of the analytic 
task converged to produce the cogni- 
tive model described in Section 6. The 
work represented in the top half of Fig- 
ure 1-1 was a data-gathering, analysis, 
and synthesis effort directed at defin- 
ing the process of intelligence analysis 
as performed by ite practitioners. ‘The 
work represented in the bottom half of 
the figure was directed at defining the 
underlying processes of intelligence 
analysia in terms of cognitive functions. 
The cognitive mode! thus Is a blending 
of the information gathered and gen- 
erated in answering these two ques- 
tions. 
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Figure 1-1. The study Approach 


1.5.1 Study of SIGINT Production 
Model 


The Initia) task involved a preliminary 
investigation of signe! intelligence to 
Identify those SIGINT task processes 
which appear to have a high analytical 
and judgmental content. These were 
selected for further study directed at 
understanding the underlying cognitive 
processes. The basis for the initial 
investigation was the SIGINT production 
model prepared for INSCOM: 

[ SIGINT Production Model, Technicé! 
Report }. 


1.5.2 Development of the IMINT Pro- 
duction Model 


The second intelligence discipline 
investigated was imagery intelligence. 
Since no comparable producticn mode! 
existed for IMINT, the model described 
in [ Imagery Intelligence (iIMINT) Pro~ 
duction Model ] was developed in the 
course of this study to serve as a basis 
for selecting IMINT task processes 
involving high analytical and judgmental 
content. The selected processes were 
compared with similar SIGINT task 
processes In order to provide an initial 
definition of common analytical task 
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processes that crosscut the intelll- 
gence disciplines. 


15.3 Preparation of Questicnnalre for 
Detailed i:formation Collection 


The basis for development of the IMINT 
production modei was the intelligence 
processing behavior of IMINT analysts. 
a order to systematicaily col'act infor- 
mation on IMINT anelysis and to develop 
more extensive intormatior, «: SIGINT 
analysis as well, a detaied question- 
naire was prepared for inte:viewing 
intelligence personne! in both single-~ 
source and multi-source intelligence 
production activities. 


The questionnaire covered the following 
éreas of questions for each interview 
respondent: 


@ Domain Definition - respondent's 
client orientation, mission, area of 
responsibility, input types, infor- 
mation sources, knowledge base, 
product types. 


e@ Percepts and Concepts - 
respondent’s perceptual modes 
and skills, mental imagery types, 
difficult/easy tasks. 


e System/Proceduraf Contexts - 
patterns of communication activi- 
tles, management and quality con- 
trol arrangements, in pretive 
alds and references, procedural 
flexibilities experienced by 
respondent In work setting. 


e@ Dacision Procasses - respondent's 
view cf work setting situation with 
regard to conditions for making 
interpretation decisions, interpre- 
tation decision controls, adapta- 
tion decision mechanisme used. 
and prevailing adaptation arrange- 
ments. 


e Motivational Aspects ~ 
respondent's views of career path 
modele, personal goals and expec~ 
tations, goal attainment criteria, 
relevant skills and knowledge 
baze development. 


18.4 Site Visits and Analyst inter- 
views 


The questionnaire was used as «4 basis 
for cenducting the interviews listed in 
Figure 1-2. Ajithough a number of 
relavant Army anc DoD manuais and 
reports also provided important basic 
data for this study (see references), 
the richest source of information was 
the community of analysts interviewed 
atid observed as they carried out the'r 


Of pariicular Interest are the terms 
analysts use to refer to themselves and 
their work. They often see themselves 
6s “detectives,” “historians;" their 
work is like “solving a mystery," a "puz- 
zie," requiring “deduction,” “imagina- 
tion," and "complete concentration.” 
The quiding principle is not only to look 
and to listen but, .more importantly, to 
think. 


These concepts provided insights into 
the identification of the core analytic 
functions and the cognitive mechanisms 
underlying them. The evoiving cognitive 
model was updated and refined in terms 
of data that indicated significant vari- 
ables in the analytical environment 
(described in detail in Section 4.1), in 
individual training, experienca, and 
knowledge base development (Section 
4.2), and in key processes in the 
analyst’s cognition (Section 6). 


1.5.5 Selection of Analytical rocess- 
ing Functions for in- Depth Study 


In doth the SIGINT and IMINT studies, a 
set of analytic processes--identified as 
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' WO, INTERVIEWS /SPECIALTIES 
P ARMY INTELLIGENCE AND SECURITY COMMAND (INSCOM) 2/SIGINT { 
C NATIONAL SECURITY AGENCEY (NSA) 6/SIGINT, 2/IMINT 7 
i 3/IMINT 
} NATIONAL PHOTOGRAPHIC INTERPRETATION CENTER (NPIC) | 6/IMINT 
( ! 626 MI GP, MIBARS, FT. BRAGG 10/IMINT ‘ 
I ARMY/AF EXERCISE, SHAW AFB 12/IMINT ; 
j 3426 TECH TRAINING, OFFUTT AFB 6/IMINT : 
' USAICS, FT. HUACHUCA 13/IMINT, 2/SIGINT ‘ 
i INSCOM 3/IMINT i 
| NPIC 1/1MINT 
3 
i FT. DEVENS 10/SIGINT i 
} 
t ; 
k BLUE FLAG, FGLIN AFB 6/MULTI-SOURCE ; 
i 
FORSCOM EXERCISE, FT. A.P. HILL 16/MULTI-SOURCE ‘ 
CPAR, FT. MEADE 9/SIGINT 
12/MULTI-SOURCE 
SIGINT = 28 INTERVIEWS { 


IMINT = 656 INTERVIEWS 117 INTERVIEWS TO DATE H | 
MULTI-SOURCE ® 33 INTERVIEWS | 7 | 
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Figure 1-2. Summary of Sites Visited for Data Gathering i 
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serving functions common across the 
disciplines of SIGINT, (MINT, HUMINT, 
and multi-source intelligence-- was 
sciected for further analysis and 
cross-discipline comparison. 


The following criteria were used to 
select analytic processes incorporating 
common functions: 


e Analytical orientation ~ whether 
the process Is mainty analytical or 
primarily control and management 
oriented. 


e Generality - whether the process 
appears general o intelligence 
analysis or specific to the particu- 
lar discipline of SIGINT or (MINT. 


e interpretive Complexity - 
whether the process’ involves 
sparse, possibly conflicting, data 
that is subject to many potential 
interpretations, or detailed and 
unambiguous data whose interpre- 
tation is relatively straightforward. 


e Level of Aggregation - whether 
the prrocass involves discrete, 
low-level data patterns or a more 
abstract level of information that 
has been aggregated one or more 
times (for example, SIGINT target 
detection verstius  multi-source 
fusion). 


Figure 1-3 shows an initial selection 
chart for IMINT processes in terms of 
these criteria (abbreviated to ANAL, 
GEN, IC, and LOA, respectively). The L, 
M, and H labels in the figure indicate 
the evaluation of each process as rela- 
tively low, medium, or high with respect 
to the given criterion. Processes that 
were evaluated as fow in analytical 
orientation or generality across all thrse 
processing phases were not selected. 
The processes selected are boxed in 
the figure. 


For purposes of comparing SIGINT and 
iMINT, the following analytic processes 
commcn to both were selected: 


e Search 

e Target Detection 
Target Identification 
Verget Development 
Unusualness Analysis 
Funciiorial Analysis 
Studies 


Complex 
Analysis) 


(a.g., OB 


e Associated Reporting Processes 


1.5.6 Comparison of SIGINT and IMINT 
Analysis 


Using the common task processes 
selected above as a framework, com- 
parisons were made between SIGINT 
and IMINT along the following dimen- 
sions, which are described in detail in 
Sections 2 through 6: 


e Strategic versus tactical intelli- 
gence production. 


@ Environmental and individual vari- 
ables: 


— Type of data used. 
— Work setting. 
— Client mission. 


— Training, experience, and 
knowledge base development 
and maintenance. 


— Attributes of a good analyst. 


e@ Use of complex conceptual models 
in analysis. 


SIGINT and IMINT are generally per- 
ceived as entirely different because of 
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SECOND PHASE | THIRD PHASE 
PROCESSING PROCESSING 


LOA! ICREN ANAL LOA] ICGEN ANAL LOA] ‘CHEN ANAL, 


INTERPRETATION 


Search 

Target Detection 

Target identification 
Target Quantification 
Unusuainess Analysia 
Function Analysis 

Complex Studies 
Photogrammetric Sciences 


rPeeeer 


REPORTING 


First Phase Reporting 
Second Phiase Reporting 
Third Phase Reporting 


SUPPORT ACTIVITIES 
Collection Coordination 


History of Coverage Maintenance 
Target Development 
interpretation Key Devel. ment 





Figure 1-3. Analytic task processes selected for additional 
study are enclosed. Any activity scoring low In GEN or ANAL for 
the three processing phases was eliminated for further study. 


the dissimilar modes of date capture 
and resulting perceptual differences 
(hearing signals and viewing signal- 
analysis displaye versus viewing 
terrain-based imagery). in fact, some 
rather striking parallels emerged from 
the comparison of SIGINT and IMINT 
analysis. The most significant of 
these was the use of complex con- 
ceptual models in analytical work. 


A conceptual mode! consists of a pat- 
tern of generalizations about a given 
category or range of experience, which 


depicts a relation or relations between 
two or more entities, where an entity 
ma, be an object, an individual, or an 
event. 


For example, IMINT analysts may have a 
conceptual model of a surface to air 
missile, In which the model depicts a 
functional interdependency between a 
missile and Its transporter. If they then 
see a missile transporter with no missile 
on it, they may search the surrounding 
area for places of storage or conceal- 
ment for the missile. Examples of more 
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complex conceptual models are the 
ideas of a communications net, an Order 
of Battle, a Table of Organization and 
Equipment, the general relationships 
between terrain physical characteris- 
tics and mob‘ ‘ty characteristics, a col- 
lection system, etc. 


Another Important paraiiel between SIG- 
INT and |IMINT analysis emerged from 
what analysts saw as the key attri- 
butes of 1 good analyst. Both SIGINT 
and IMINT analysts stated that a good 
analyst Is a “detective”, that is, one 
who discovers what is concealed or 
tends to elude observation, one who Its 
solving a mystery or a puzzie. The 
effective analyst must have "Imagina- 
tion™ in order to generate good 
hypothes' s about what is happening 
and what sight be conceaiad, and to do 
some "detective work" to collect evi- 
dence that confirms or refutes these 
hypotheses. it Is important to “be a 
historian" because one must know what 
has happened in the past in order to 
understand what is happening in the 
present and what is Iikely to happun in 
the future. 


The major differences between SIGINT 
and IMINT analysis are attributable to 
differences in modes of data capture 
and resulting different perceptual 
requirements. Several of the SIGINT 
specialities require a great deal of 
specific data-capture training 
(language, morse) In addition to general 
training in military science (and other 
areas discussed in Section 5). IMINT 
analysts on an inactive mission may 
devote off-duty time and Idie time on 
duty to increasing thelr general 
knowledge about the geography and 
cultural background of the rea si mis- 
sion responsibility, or about types \of 
military equipment Iikely to appear in 
imagery generated during exercises. 


While IMINT analysts are able to spend 
tlme In bulldmg and maintaining the 
store of conceptual models that forms 
the internal knowledge base, SIGINT 
analysts on an inactive mission are 
more concerned with not losing 
language or morse proficiency, rather 
than with Increasing or maintaining gen- 
eral or military knowledge. 


Both SIGINT and IMINT analysts find 
assignments to inactive missions In the 
tactical environment frustrating 
because they like their analytical work 
and know that lack of practice leads to 
loss of proficiency. The SIGINT analysts 
have more to lose in such a situation, 
since data-capture mode knowledge 
(language, morse), as well as general 
and military knowledge, will inevitably 
degrade. 


Similarly, although both SIGINT and 
iMINT analysts prefer analysis to 
management, SIGINT analysts who 
moved to management positions where 
thelr voice or morse proficiency was not 
used expressed the most frustration 
because of the substantial amount of 
time they haa devoted to their early, 
extensive, career training. 


In general, the similarities between SIG- 
INT and IMINT analysis far outweigh the 
specific differences attributable to dif- 
ferent data-capture modes and, conse- 
quently, to different modes of percep- 
tion. 


1.5.7 Extension of the Comparison to 
HUMINT and Multi-Source Analysis 


Although a detalied, intensive investiga- 
tlon of HUMINT was not within the scope 
of the study, some observations of 
HUMINT analysts at work were made 
and several discussions were held with 
IPW (interrogation of Prisoners of War) 
analysts. For the most part, it appears 
that the generalizations about SIGINT 
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language specialists made in the 
preceding section also apply to HUMINT 
analysts. A major difference is the 
greater importance of special verbal 
skills for HUMINT analysts, who spend 
many hours interviewing in a foreign 
language. Anower difference is the 
relatively greater importance, for 
HUMINT analysts, of access to multi- 
source information, which provides them 
with the necessary knowledge base for 
helping to elicit information from per- 
sons being interviewed. 


Extending the comparison to multi- 
source analysis, the major differences 
between single-source and muiti-source 
analysis involve: 


e higher levels of aggregation of the 
*, Information to be analyzed in 
muiti-source, and io some extent, 


® greater /nterpretive complexity for 
multi-source because of tne rela- 
tively greater number of concep- 
tual models to be considered. 


1.6 Conclusions and implications for 
the Cognitive Model 


The most telling result of this study is 
the clear implication that intelligence 
analysis is conceptually driven as 
opposed to data driven. What Is critical 
is not just the data collected, but also 
what Is added to those data in inter- 
preting them via conceptual models in 
the analyst's store of knowledge. 


The most Important parallel between 
SIGINT, IMINT, HUMINT, and multi-source 
analysis involves the use of a large 
variety of complex conceptual models 
In analytic activities. 


The core functions of intelligence 
analysis invoive the use of complex 
conceptual models. in turn, the use of 
such models la dependent upon /nd/vi- 
dual variables such as: 


ais on eeeeeniae tt = 
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@ Ability to acquire anti comprehend 
complex conceptual models. 


@ Ability to generate end evaluate 
new conceptual models 
(hypotheses). 


e Knowledge, consisting of a general 
mental inventory of available con- 
ceptual modeis, including mental 
"Index" to locations of models in 
external memory (in the form of 
colleagues, files, references, alds, 
etc.). 


e@ Accurate, rellable memory func- 
tioning. 


e Special interests and orientations 
toward conceptual modeling as an 
activity In its own right, including 
explicit recognition of models as 
mental phenomenon, and selective 
attention and selective memory for 
certain kinds of conceptual 
models. 


e@ Mental flexibility and ability to 
learn from past experience. 


The use of such models is also depen- 
dent upon environmental or work settin. 
variables impacting ths enalytic pro- 
cess, such a3: 


@ Cilent orientations (support of tac- 
tical versus strategic command, 
Indications and Warning, mission 
ops, plans, logistics). 


@ Production management and task- 
ing (mission, area of interest, pro- 
duct accounting, tasking agencies, 
work breakdcwn structure). 


e Information acquisition (collection 
plan, collection gaps, predictabil- 


ity). 

e Domain (geographic areas, 
sociocultural characteristics, ter- 
rain features, weather, 
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economics). 


e Date types (sensor types, 
observers, filtered data, analytical 
results, expectations). 


e Judgmental factors (priorities, time 
available, communication 
bandwidth, significance). 


e System supports (displays, data 
bases, colleagues, references, 
computational aids). 
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oe 


Because both individual and environ- 
mental variables affect the analyst's 
cognitive performance, the model of 
cognitive processes underlying intelli- 
gence analysis must show sensitivity to 
: these veriables. 
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Figure 2-1. Structure of Relations Between Analytic Specialities 


2. FRAMEWORK FOR INTELLIGENCE 
ANALYSIS COMPARISONS 


particular context within which the work 
setting resides. Analysis of the overall 
organization of intelligence production 


The main dimensions for comparing intel- 
ligence analysis specialities are 
reflected In the work settings in which 
the specialities are performed. These 
dimensions include differences in 
amounts and modes of data to be 
analyzed, assigned domain from which 
data are generated, kinds of analytic 
tasks to be performed on the data, the 
general range and conceptual level of 
concerns that are to ba brought to bear 
in considering the data, and the 


activities in such terms led to the 
development of the multi-dimensional 
structure shown In Figure 2-1, which 
depicts work settings for various types 
of SIGINT, IMINT, and HUMINT process- 
ing, and their relation to work settings 
in which higher levels of intelligence 
data processing are accomplished. 


The bulk of Figure 2-1 consists of four 
Interconnected sets of columns depict- 
ing the overall intelligence system. At 
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the left of the figure ls shown the intel- 
ligence information cycle, which con- 
sists of a generalized sequence of four 
Information processing phases that 
oocur throughout the systen at most 
levels and for most modes of data: 


e Colisction of data that is indica- 
tive of capabilities or intentions. 


eo Firat phase exploitation of data 
(high threat and limited response 
time window). 


e Second phase exo! tation of 
data (for current arations and 
altuation assessment). 


e Third phase exploitation of data 
to support basic intelligence 
needs and special requirements, 
and review of conceptual models 
used to Interpret data. 


2.1 Organizational Structure of intel- 
ligence Analysis Tasks 


The main types of settings for intelll- 
gence analysis are portrayed across 
Figure 2-1 from left to right: 


e@ Various modes of intelligence col- 
lection (SIGINT, IMINT, HUMINT). 


@ Single-source correlation and pro- 
du stion. 


@ Multi-source aggregation and 
fusion (over time and sources) 
ac. ording to mission orientation 
(IPB, Targeting, Situation Assess- 
ment, OPSEC). 


e Specific clilent-orlented informa- 
tion product packaging. 


in the figure, main data-fiow paths are 
om feft to right, with a corresponding 
werease In e.ygregation of data. 


2.2 Communication Factors 


Besides the main data flows, Figure 2-1 
Indicates that the various types of work 


settings are also linked by four kinds of 
communication factors: 


e Communication models. 


@ Formal Information flow arrange- 
ments. 


@ Informal communications. 

0 Job rotation. 
Each of these are considered below. 
2.2.1 Communication Models 


A communication model is a common 
conceptual model shared by parties who 
use it as a means of communication. 
Such shared conceptual models link 
intelligance work settings. As defined 
earlier, a conceptual model consists of 
a pattern of generalizations about a 
given category cr range of experience, 
which depicts a refation or relations 
between two or more entities, where an 
entity may be an object, an individual, 
or an event. Shared conceptual models 
are the basis for common understand- 
ings of many mutual concerns, Including 
the characteristics of intelligence tar- 
gets, collection capabilities, use of col- 
lection capabilities, and the operating 
environment. These models = are 
refiected in training plans, in operating 
Aoctrina, and ' knowledge bases used 
by analysts. 


2.2.2 Formal information Flow Arrange~ 
ments 


Linking the different special work sat- 
tings are flows of information through 
formal communication channels (record 
and message traffic, mail, command and 
control communications networks, writ- 
ten orders, etc.). These carry require- 
ments, tasking, raw data, filtered data, 
and analytical results and products. 
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2.2.3 Informal Communications 


informal communications (via secure 
telephone, meetings, consultations iwith 
peers, Interactive digital comnunica- 
tions networks, and personal le*.ars) 
link the work settings, provicirg 
analysts with clarifications, feedbaci:, 
and ready extensions of thelr own 
analytical capabilities. A funccdon often 
served by Informal communications is 
that of making analysts aware of larger 
perspectives. interviewed analysts 
observed that when they were left 
unaware of the “big picture," they felt 
lso'ated end were less able to advance 
their skills. This condition was cited us 
being more prevalet In tactical units 
without an active mission. Analysts in 
strategic facilities do not exhibit this 
concern, because of larger local analyst 
populations and better facilities for 
sharing Information with other organiza- 
tlons. 


2.2.4 Job Rotation 


ob rotation through different work set- 
tings serves to iink the settings. 
Analysts report that receiving a variety 
of tactical and strategic assignments 
develops a perspective aLout availabie 
Information sources (Including personal 
contacts) that are used in analysis. 
Anatysts whe heve strategic assign- 
ments prior to entering the tacticai 
environment know where to obtaln tac- 
tically usefu! ali-source Information. 
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Figure 3-1. Generic Intelligence Production Model 


3. GENERIC INTELLIGENCE PRODUC- 
TION MODEL 


Analysis and comparison of SIGINT, 
HUMINT, and multi-source intelligence 
production ied to the development of a 
model of generic Intelligence production 
processes, shown in Figure 3-1. The 
model characterizes observable 
processes common to the three special- 
tties. The processes sipport three 
interrelated generic functions per- 
formed in analytic work settings: 


e@ Resource Management 





e Adaptation 
e Interpretation 


interpretation (which encompasses data 
processing, analysis, and reporting) Is 
the function usually cons/dered as intei- 
ligence analysis. However, the 
reso:rce management and adaptation 
functions are also included in the 
present model because of their impor- 
tant effects on the quality of the ana- 
tytic product and because Interpretive 
decisions are often required for 
resource Management.and adaptation. 
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3.1 Resource Management 


The resources allocated to intelligence 
analysis include: 


° Time. - 

@ Analytic personne! capabilities. 
@ information flow. 

@ information storage capacities. 
@ Collection assets. 

e System facllities. 


e Resource management capabdill- 
ties. 


@ Adaptive capabilities. 


As Indicated in Figure 3-1, resource 
management tasks include planning, 
alicuation, and tasking. Each of these 
tasks Involves decision making by 
analysts es well as management. Vari- 
ables considered In resource manage- 
ment decision making include: 


@ Leval of threat. 

@ Avaliiability of resources. 

@ Priorities. 

e@ Short term vs. long term benefits. 


One of the most important managed 
resources |s time. Mechanisms used to 
adjust production to time pressures 
include: 


@ Segimenting production into phases 
oriented to product suspense 
times. 


e Controlling the size of geopraphic 
area, or number or types of tar-~ 
gets handled by one analyst. 


@ Assigning priorities so that time~ 
sensitive data gets haniied first. 


in the context of producing specific 
products, the analyst makes many 
resource management decisions. 


Fe ayer ee ran on FP AER Hh 


Analysts must frequently support muiti- 
ple missions concurrently and divide 
thelr time between several tasks. 
Analysts may serve several clients 
when producing analytical results and 
must make compromise decisions on for- 
mat and content. The analyst must also 
find time to secure the long-term bene- 
fits of skii maintenance and 
knowledge-base development. Anslysts 
who were interviewed felt that they 
had fess control over this last category 
than was necessary to develop and 
maintain their proficiencies. , 


3.2 Adaptation 


Adaptation is the development of 
appropriate new responses, by what- 
ever means, in tie face of significant 
change. Figure 3-1 shows the adapta- 
tion function as a key feature of the 
generic intaliigence production model. 
Adaptation of the intelligence produc- 
tion process raquires that both the 
erganization and the enalysts examine 
the quality of products and use what- 
ever means are available to correct 
deficiencies. Adaptation takes place at 
both individual and organi «tional levels. 


3.2.1 Individual Adaptation 


it is impractical to tightly control intelli- 
gence production fy external monitoring 
and quality-controi checks. The quality 
of a particular piece of work can be 
checked only by replicating the entire 
procoss, using another analyst with 
better qualifications, and then making a 
comparison. This cannot be dore on a 
large scale because of the high cost of 
the duplicative effort. Thus, the adap- 
tive capabilities of the individual 
analyst are at a premium. Individual 
adaptive activities are exemplified by 
the following behaviors observed during 
site visits: 
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-@ Making voluntary judgments about 
own performance. 


-© Seeking informal feadback chan- 


-e Using non-standard processing 
strategies (whatever works). 


-@ Using own Initiative for increasing 
awareness in significant areas 
(information entrepreneurism): 


— Seeking cues from other intwill- 
gence sources. 


— Seeking cues from associated 
elements or processes. 


— Developing contacts In intelli- 
gence community or within 
facility. 


— Developing cultural knowledge 
to aid In distinguishing cultural 
background features from sig- 
nificant data. 


— Building continuously the 
knowledge of "how things 
work" to aid in interpreting 
sparse data (e.g., maximum 
speed and incline capacities of 
vehicles, weapon ranges, 
optimum transmitter positioning 
requirements, etc.) 


3.2.2 Administrative Adaptation 


Like the individual analyst, the intelli- 
gence organization utilizes various 
adaptive mechanisms when faced with 
new problems. If a target area that 
was not being followed in depth sud- 
danly becomes important, the organiza- 
tion may face several! adaptation prob- 
lems: 

e@ Inattention to the area may have 


resulted in gaps in reference 
materiais. 
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e@ Analysts reassigned to the new 
area will have a_i substantial 
start-up time to become familiar 
with the targets and achieve con- 
fidence in interpretations. 


e@ Sociocultural knowledge may not 
be current for analysts who must 
work a new geographic area. 


The administrative adaptation process 
ts important in the study of intelligence 
analysis because it contributes factors 
basic to analytic performance. One of 
the strengths of strategic intelligence 
organizations is that they are able to 
use highly experienced and qualified 
analysts in the producticn process. 
These analysts accumulate a large 
store of knowledge on specific target 
areas and are able to perform in-depth 
interpretations. Sociocultural 
knowledge at the strategic level can ba 
supplemented by immediate access to 
State Department and civilian sources. 


Because stretegic production resources 
are limited, some target areas’ must be 
assigned lower priorities. However, 
computer data bases maintain archival 


files of target information stored earlier . 


that can be recovered easily after long 
periods of lowered attention to particu- 
lar targets. Such data serve as base- 
lines for renewed closer attention. 
Communication networks make such 
data available on ai shured basis 
throughout the strategic community. 


On the other hand, intelligence produc- 
tion facilities in tactical echelons below 
corps are faced with adaptation 
requirements every time the supported 
tactical unit must prepare for a con- 
tingency operation. The tactical intelli: 
gence unit is at a disadvantage in 
adapting to new contingencies for a 
number of reasons. Analysts are likely 
to be less experienced than at the 
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Figure 3-2. Sequence for intelligence Interpretation Task 


strategic level, and highty experienced 
analysts may be unavailable to assume 
training roles. Personne! shortages may 
draw analysts away from analytic tzain- 
Ing duties. If the unit does not have a 
current active mission, analysts may not 
be current on the intelligence threat 
and may not be garrisoned In a location 
close to the resources needed to main- 
tain knowledge for areas of likely 
operation. Storage facilities are often 
not avaliable for archival data that 
would be useful in preparing for a wide 
range of contingenciss. Personnel 
clearances and billets for sensitive 
compartmented Information may be in 


short supply. Real data may be unavail- 
able for analysts to work with. Interac- 
tion =with =community intelligence 
resources is sometimes difficult. 


In the worst case, the tactical unit must 
depend almost entirely upon the indivi- 
duel skills and backgrounds of analysts 
to adapt to new operational require- 
ments. 


3.3 Interpretation 


Although the generic production model 
depicts interpretation as only one of 
three main analytic functions, It is, in 
fact, the basic one. Figure 3-2 shows 
the interpretive processes as a cycle 
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Figure 3-3. interpretive Complexity as a Function of Data Richness 
and Number of Supportabie Interpretations 


of (1) receiving Incompiete or sparse 
data, (2) interpreting the data, and (3) 
formujating the intelligence product 
(messages, estimates, etc.). The cen- 
tral function of Interpretation invoives 
making many Information filtering deci- 


‘gions in the process of converting 


sparse or uneven input data to Intelli- 
gence prcducts. The basis for such 
decisions is usually memory-storad con- 
ceptual models of the types of real- 
world objects or events thought to 
have generated the data being ‘nter- 
preted. 


Figure 3-2 also summarizes our obser- 
vation that, of the information going into 
the Interpretive product, a greater 
amount comes from conceptual models 
stored In memory (both Internal and 
external memory), than from the data 
being Interpreted. In other words, Intel- 
ligence analysis is usually more a 
concept-driven than ai data-driven 


process. 
3.3.1 Interpretive Complexity 


interpretive complexity is a composite 
evaluation of the relative difficulty of 
anslytic tasks. Interpretive complexity 
is inversely proportional to the richness 
of the Input data and directly propor- 
tlonal to the number of reasonable 
alternatives against which an interpre- 
tive decision must be made. Figure 3-3 
illustrates this relationship. Thus situa- 
tions which are the most difficult and 
complex to Interpret are those In which 
there are few data available but for 
which many viable interpretations are 
possible; other situations in which there 
ere many data that point to a single 
obvious Interpretation are low In inter- 
pretive complexity. 


Another factor in 'nterpretive complex- 
ity Is the level to which the input data 
have been aggregated. Data may be 
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aggregated over periods of tine, over 
muttiple sources, or in leveis of 
abstraction (e.g., n artillery pleces vs. a 
battery). Aggregation of input data can 
work positively or negativeiy in the 
interpretation process. If the aggrega- 
tion is done properly, the richness of 
the Input data is increased and inter- 
prative complexity is lessened. On the 
other hand, aggregation can interject 
blases due to normalization, to incorrect 
interpretation fr abstraction, or ta remo- 
val of valid ambiguitics in preprocess- 
ing. 

Based on our observations three con- 
clusions about interpretive complexity 
have been drawn: 


e The more complex interpretation 
tasks are usually performed by 
more experienced analysts better 
able to cope with higher leveis of 
data aggregation. 


e interpretive complexity ls often 
greater in work settings using high 
levels of data aggregation, 
because analysts must make deci- 
sions on the interpretation quality 
of thelr inputs as well as make 
their own aggregation choices and 
Interpretive decisions. 


e There is sometimes distrust of. 


interpretations received from work 
settings at ‘ower levels cf aggre- 
gation unless the using analyst 
has trust in the source. 


3.3.2 Knowledge used /n interpreta- 
tion 


” The requirements for the knowledge 


needed to perform interpretations have 
their origin In one common definition of 
intelligence: 

intelligence is the identification of 


threat; the two components of threat 
are capabilities and intsntions. 


The accurate and timely Identification 
of three requires the use of much 
sophisticated knowledge organized 


-afound conceptual models. Potential 


threat Is inferred at the national level 
from scenarios (conceptual models) 
dapicting capabilities of: 


e Military forces. 

e Weapons. 

e Strategic industries. 
e@ Economic factors. 


e Organization and distribution of 
power. 


@ Strategic and tactical dis siticn 
of forces and weapons. 


o Electroic warfare capabilities. 


Inferring intentions to use such capabil- 
ities Is more difficult. Conceptual 
models of necessary buildup patterns 
for threatening behavior are used to 
infer current and future intentions. The 
modets identify categories of indica- 
tions and warning signs that are 
observabie thrrugh collection assets. 
Examples of such indicators are: 


@ Provocative diplomacy. 
@ Threats/ultimatums. 

e Hostile political actions. 
Intimidation. 

Minor military action. 


Major military action. 
Milltary augmentation. 


Domestic conflict. 
e Exercise. 

e Peacefu! diplomacy. 
e Verbai conflict. 
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in a paraile! process, tactical threat Is 
inferred from scenarios depicting capa- 
olities of such things es: 


@ Postitioning and capabilities of indivi- 
dual large weapons. 


e Positioning and capabilities of mili- 
tary units of significant size. 


Movements of weapons and units. 


@ Positioning and movement of logisti- 
cal units and headquarters. 


The best-known threat modei is Order 
of Battle (OB). The OB can be imple- 
mented in hardcopy or computer data 
base form. OB provides capability 
inodeis of force structures, weapons, 
status, and disposition. OB also pro- 
vides insight into intentions of the 
forces by implication from training, 
readiness status, tactics, personality of 
commanders, and strategic or tactical 
disposition cf the forces. OB data is 
used at ali echelon levels, but Is 
tailored to the geographic area of 
responsibility an’ to a level of detail 
that is meaningful to the current situa- 
tlon. 


indicators of threat guide the develop- 
ment of further intelligence information 
for determining vulnerabilities and plan- 
ning responses. in planning responses, 
behavior modeling is used to develop 
and to authenticate models of possible 
antagonist reactions. These models 
predict probable antagonist responses 
under given sets of circumstances. The 
Importance of behavioral! modeling fies In 
Its ability to project “what if?" situa- 
tions. Because of the predictive nature 
of these models, they produce specula- 
tive, probabilistic results and require 
continuous refinement and adjustment 
to maintain thelr usefulness. 


Other types of models frequently used 
in Intelligence analysis are: 


e Models of enemy = surveillance 
capabilities and effects of terrain 


and ECM. 

e Political organizations and control 
of power. 

e Command and control organiza- 
tions. 


@ Personality profiles. 
e Terrain models for use in traffica- 


bility or tactical disposition 
analysis. 

e@ Ethnographic models. 

e Chain of events. 

@ Time and frequency patterns. 

e Industrial production models. 

e Weapon system performance 
models. 


e Economic models. 
e Lines of communications. 
e Network modeis. 


These models may be used to transfer 
general characteristics of known 
threats to unknown threats by analogy, 
and to develop higher feveis of threat 
information by piecing together Incom- 
plete fragments of data (such as in the 
Cuban missile crisis, when the 
existence of Soviet missiles in Cuba 
was ascertained from the shapes of 
shipboard containers and from tracks of 
heavy vehicles around similar shapes 
seen Inian4). 


3.3.3 Using Interpretive Models 


The main processes of interpretation 
invoive the extensive use of concep~ 
tual models. The skilis that enable the 
analyst to exploit conceptual modeis 
include: 
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Formulation of conceptual models. 


Storage and retrieval of data 
using models as the indexing 
framework (such as_ situation 
overlays, OB, installation files). 


Communication with clients by usa 
of models to provide extensive 
information to supplement the con- 
tent of messages (such as clients 
who have locai OB files, mission 
plans, IPB overiays, etc.). 


Correlation of observable real 
world events with model parame- 
ters to deduce capabilities or 
intentions (such as matching unit 
maneuvers to the beginning of a 
mobilization). 


Use of models to inductively 
determine the threat from unknown 
elements where analogies exist to 
known threats (such as extrapola- 
tion of Soviet military doctrine to 
satellite countries). 


Inference of event significance by 
carrying cause and effect rela- 
tionships to logical ends (such as 
Impacts of weapon augmentation). 


Fusion of data by abstracting to 
higher levels of behavior (such as 
lower echelon units into higher 
echelon units or individual targets 
into target clusters). 


Compensation for incomplete inte!- 
ligence data by fill-in from models 
(such as using unit identification 
and location to identify probable 
locations of associated units). 


Attention to serendipitous events 
that do not correlate with known 
models (such as detecting a new 
weapon system that is dis- 
tinguished from an old system only 
In one externally observable 


characteristic). 


e@ interpretation of ambiguities by 
matching to multiple | :odels (such 
as a unit that could belong to 
either a motorized rifle regiment or 
a tank regiment). 


@ Recognition of uncertainty in 
interpretations by determining par- 
tial matching of events to models 
(such as being able to locate and 
identify only 60% of the maneuver 
units in an observable force 
whose structural mode! calls for 
40% more). 


3.3.4 Filtering of Products 


tn addition to the conceptuai model han- 
dling skills, the intelligence analyst must 
have the Important decision-making 
capability of controlling and filtering 
data output to the client. In deciding 
which information should be passed on 
to the client, the analyst uses at least 
these three mechanisms: 


e Determining change from previous 
products. 


e Understanding the needs of the 
client and utilizing informal feed- 
back to adjust the content of pro- 
ducts or provide clarifications. 


e Structuring the output product 
form such that it is self-defining in 
terms of its relation tc clients’ 
areas of interest and quality of 
interpretation. 


The contro! of intelligence product 
dissemination is largely a manual pro- 
cess Involving large distribution’ fists 
that evolve over an extended period of 
time. In some work settings, an analyst 
must designate action and information 
recipients, select a product form, 
assign precedence, and select a 
transmission mode. These decisions 
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determine the content and speed of 
delivery of the product. 


Intelligence products that are highly 
formatted and transmitted electrically 
may be processed directly Into cllent 
: computer data bases. When the client 
i does not have computer assistance, the 
product flow rate must be controlled by 
the intelligence production source to 
prevent saturation of the routing sys- 
tem and the recipients. 


3.3.6 Summary of Intelligence Produc- 
tion Model Characteristics 


To summarize, the generic model of 
Intelligence production processes iden- 
tifies three main functional areas: 
adaptation; resource management; and 
Interpretation. The general types of 
tasks, such as monitoring and evalua- 
tion, production planning, tasking, pro-~ 
cessing, analysis, reporting, and special 
product design serve these three main 
functional areas. 


The central function of interpretation 
involves making many Information filter- 
ing decisions In the process of convert- 
ing sparse or uneven input data to 
Intelligence products. The basis for 
such decisions Is usually memory-stored 
conceptual models of the types of 
real-world objects or events thought to 
have generated the data being inter- 
preted. 


Comparison of the information consti- 
tuents of intelligence products with the 
information constituents of the data 
supporting the products shows that 
often a large proportion of the informa- 
tion in the products has been added 
from memory. Thus, the interpretive pro- 
cess is often more concept-driven than 
data-driven. 





ers ee op op 


ogre ping we me en 


sere 





I TET 


re ae 





SS) BOTAN UO RIE 2. <M, meme mene ae eh cena 
a 


ore pe 


| 
| 





Pe Tere oy, 














Poem seer em eg tee ue 


4. ENVIRONMENTAL VARIABLES 


Environmental or work setting variables 
affecting analytic performance are 
important in the development of the 
cognitive model because they cir- 
cumscribe the range of perceptions, 
decision making considerations, and 
constraints which the analyst experi- 
ences as a result of performing analytic 
tasks in a given work setting. The 
scope of environmental variables 
affecting the cognitive processes of 
analysts is summarized in the diagram in 
Figure 4-1. 


4.1 Assigned Domain 


An assigned domain usually consists of 
geographic boundaries within which 
data representing certain target types 
are to be interpreted. Deep familiarity 
with geographic, climatic, and soclocul- 
tural aspects of the assigned geo- 
graphic domain is a basic asset to the 
intelligence analyst. intimate familiarity 
with the domain aids in identifying mill- 
tarily significant targets and in antici- 
pating constraints on military opera- 
tions. The domain variables depicted as 
impinging on the analyst in Figure 4-1 
become especially obvious during a 
change of geographic domain. When- 
ever an analyst is reassigned to a dif- 
ferent geographical domain, even 
though the types of targets may be the 
same the analyst usually requires a 
substantial start-up time to regain peak 
performance levels. The same is true of 
reassignment of target types within the 
same geographic boundaries. 


4.2 Management and Tasking 


Management directives define the 
domains of an analyst’s geographical 
and functiona: areas of responsibility In 
the overall production picture. These 
tasking constraints change with time. 
Overlaps in assigned responsibilities are 


meee 


minim'zed to make efficient use of rela- 
tively scarce analytic personnel 
resources. Nevertheless, requirements 
for maintaining overiapping knowledge 
for different areas of responsibility are 
very common. The intefligeice commun- 
ity attempts to develop and exploit 
such overlap through working groups, 
information distribution, integrated com- 
puter data bases, and informal communi- 
cations. 


4.3 Client Orientations 


Figure 4-1 shows clilent orientations 
affecting the analyst. Attention to a 
particular client can improve the value 
of the analysis product for that client. 
This goal is sometimes difficult for the 
analyst to achieve in practice, because 
many cifents are simultaneously served 
by the production process and the pro- 
duct may thus require an Inclusive or 
compromise format. The Importance of 
one client’s needs over another also 
changes. 


Tactical intelligence production units 
have multiple client orientations both in 
garrison and in deployment. Tactical 
intelligence units ere typically attached 
to a tactical unit commander, and 
thereby assigned main client. At the 
same time, the ta cical inteliigence unit 
also has the general intelligence com- 
munity as a client. It is important to 
note that the "perceived" client is more 
critical than the actual end users of a 
product; an individual analyst or an 
intelligence unit may adapt to satisfy 
some goal, but the intended user Is not 
always the sole beneficiary. 


4.4 System Supports 


The supports avellable in the intelll- 
gence production facility are important 
to analytic performance. Computational 
alds and secure communications are 
valuable assets. Storage space for 
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Figure 4-1. Variables in Analytic Work Settings 


maps and secure data can make a sub- 
stantial differance in analytic perfor- 
mance. Film processing facilities are 
important to IMINT In the same way that 
electronic signal recording and repro- 
cessing equipment is important to S!IG- 
INT. 


4.5 Knowledge Base 


The knowledge base or external store 
of information applicable within a given 


intelligence environment is maintained in 
the form of materiais such as refer- 
ences, archival data files, and computer 
data base systems. Computer aids are 
thought to be essential for extending 
the knowledge base to include archival 
data that cannot be effectively handled 
manually. 
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».6 Judgmental Criteria 


Analysts must exercise Judgments on a 
fairly large number of dimensions. 
These concern the possibile signifi- 
cances of new data for the needs of 
various anatytic clilents, the moment- 
to-moment optimum use of the analytic 
resources actually available to each 
analyst, and consideration of the infor- 
mation foads imposed on various ana- 
tytic clients. Furthermore, these judg- 
mental factors are not static: needs of 
Clients often change rapidly; the icad of 
incoming data to be analyzed changes 


continuously, the analytic resources. 


actually available to the analyst often 
change, and the information loads on 
various analytic cilents also varies. As 
a result of one or more such considera- 
tlona, the analyst must often modify 
task priorities and the time allocated to 
analytic tasks. in a crisis, incoming 
Intelligence data is usually voluminous, 
and client saturation may occur if the 
analyst does not actively filter analytic 
results by significance and_ client 
needs. This Is particularly important, for 
example, when the client is a near- 
real-time intelligence fusion certer. 


4.7 Information Acquisition 


The analyst normally has no direct 
impact on collection decisions. How- 
ever, the analyst usually has sufficient 
knowledge of the collection pian to 
know what type and how much data will 
be produced by a mission. For example, 
In a tactical reconnaissance mission, 
the original threat analysis may have 
determined the critical areae for sur- 
velilance and projected the types of 
targets, terrain, and concealment to be 
found in the area. The analyst may 
therefore be involved in planning the 
flight path and briefing the aircrew on 
alr defense threats. Additional informa- 
tion may be gained by debriefing the 


aircrew after the mission. 
4.8 Data Types Famiilarity/skills 


Many anatysts are specialized in one 
Particular data mode. This specializa- 
tion ts formalized by military occupa- 
tional specialities structured along the 
nes of data capture modes (veice 
intercept, manual morse, imagery, etc.). 
Specialties are also defined for 
enatysts who handle analytical results 
rather than raw data (cryptanalyst, OB, 
all-source). 


The type of data being analyzed 
impacts the analytic processes in a 
number of ways. The related mental 
imagery diffars for various data modes. 
The Information properties (comparative 
limitations, strengths, “artifactual” con- 
tributions) of different data modes 
reporting the "same" phenomena also 
vary markedly. The difficulty levels and 
amount of experience required for 
acceptable performances vary for dif- 
ferent data modes used to report vari- 
ous classes of phenomena. The 
analyst’s “mental world viewpoint" is 
conditioned by the particular data mode 
being used. 


Very little cross-mode training exists 
until the analyst moves to 4 manage- 
ment role. Within Imagery interpreta- 
tion, there are many submodes (IR, 
SLAR, forward oblique, overhead 
stereo/mono, video) that an analyst will 
have proficiency with after a combina- 
tion of tactical and strategic assign- 
mants. Substantial skill-develooment 
time is required to adapt to the specific 
data-capture mode in all specialties, 
and particularly In SIGINT. 
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8. ANALYST VARIABLES 


A majo, conclusion from the work per- 
formed on this project Is that great 
importance must be placed on the attri- 
butes of the analysts tasked with pro- 
ducing Intelligence. The main attributes 
needed are in the areas of: 


e Relevant knowledge. 


@ Skills (perceptual; conceptual; 
communication). 
@ Orientation toward managing 


relevant memory resources. 
@ Personality. 
6.1 Knowledge 


The knowledge relevant for analysis 
includes: 


e@ Military science. 

@ Science and technology. 
e@ Sociocultural knowledge. 
@ Sensor mode knowledge. 


Background in each of these areas aids 
the analyst In performing most anatyti- 
cal tasks. Commonalities and differ- 
ences in knowledge requirements for 
different analytic specialities are 
highlighted below. 


&.1.1 Military Sclence 


Commonalities between SIGINT. HUMINT, 
IMINT, and FUSION specialities Include 
an extensive knowledge of military sci- 
ence areas including Order of Battle 
and military geography. Characteristi- 
cally, this knowledge [fs acquired in 
specific relation to the targets and 
geographic area within the analyst’s 
assigned area of responsibility. The 
analyst gradually expands _ this 
knowledge base by cross-training or 
reassignment to other intelligence pro- 
duction facilities. 


&.1.2 Science amJ Technology 


Most specialities of intelligence 
analysis use almost ail for: s of physical 
acience and technology. A_ strong 
technical background heips the analyst 
understand what is seen br heard in 
data collected from technically complex 
targets such as alrcraft, missiles, 
tadars, communication nets, factory 
complexes, and tho like. The complex 
workings of weapons systems, commun- 
ications, command and control organiza- 
dons and procedures, and electronics 
systems must be understood for proper 
Interpretation of intelligence data in 
both strategic and tactical missions. 


Emphatically, this principle holds for ali 
levels of intelligence analysis as 
defined earlier. Although the inexperi- 
enced image interpreter performing a 
target focation or counting function 
requires much less general: knowledge 
and understanding than an analyst with 
a more explicit evaiuation role, all levels 
benefit by a thorough understanding in 
thelr area of responsibility. 


&.1.3 Sociocultural Knowledge 


Knowledge of a target country’s culture 
is valuable In discriminating militarily 
significant items from non-significant 
ones. Ethnography helps the analyst 
know where to look for significant items 
and what to filter out. Sociocultural 
knowledge is particularly Important in 
strategic intelligence analysis where 
the use of economic, political, and 
industrial models may be involved. 


6.1.4 Sensor Mode Knowledge 


Because the entire intelligence produc- 
tlon cycle is included in the scope of 
intelligence analysis activities, the abil- 
Ity to understand the capabilities .of 
sensor systems isa a fundamental 
knowledge requirement. Although an 
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Imagery interpreter may not need to 
know how « particular camera works, 
the constraints under which photo- 
graphic data is collected must be 
understocd when making decisions 
about collection piana and the quality of 
Intalligance products. 


6.2 Skills 


Skills invotve knowledge, but are dis- 
tinguished here from knowledge In terms 
of added requirements for highly prac- 
ticed performances. 


6.2.1 Perceptual Skilis 


The phrase perceptual skills, as used 
here, means practiced performances in 
discriminating between things on the 
basis of subtie differences In how they 
sound or look. Perceptual skills are 
especialfy important for single-source 
intelligence production. There is a 
strong consensus in the field that the 
perceptual skills fundamental to SIGINT 
and (MINT single-source production 
must be developed by using real data. 
That Is, the refined perceptual skills 
necessary to Interpret particular kinds 
of images or to recognize certain voices 
or certain morse or telegraphic \pera- 
tors cannot be fully developed in exer- 
cises disassociated from real targets. 


The anatyst’s confidence and speed in 
interpretation and in the ability to 
detect significant changes also depend 
heavily on familiarity with the particular 
target area. A substantial time pariod 
Is required to gain such familiarity even 
for experlenced analysts. SIGINT 
analysts stated that It would take two 
to six months to adapt to a new target 
area after being reassigned. IMINT 
analysts are often semi-permanently 
assigned by geographic area and/or 
target types in order to take advantage 
of the resulting accumulation of percep- 
tual familiarity. 


6.2.2 Conceptual Skilis 


The generic ‘‘“telligerce production 
model presentod earlier depicts In alii- 
gence analysis as predominantly 
concept-driven rather than data-driven. 
This conclusion was reached after 
observing the extensive memory 
resources (see Figure 3-2) that 
analysts bring to the production of most 
intelligence products, and noting that 
much of the memory-based information 
was conceptual in nature. The produc-~ 
tion process is also concept-driven In 
the sense that new intelligence pro- 
ducts can be, and often are, produced 
in the absence of new data. §Intelll- 
gence preparation of the battlefield 
(iPB) Is an example of an activity that 
depends aimost entirely on previously 
developed and stored knowledge. As 
indicted eariler In this report, highly 
experienced and effective analysts 
often appear to organize the mental 
storage of auch knowledge around con- 


ceptual models. The analyst's ability to: 


deal with conceptual! models grows as a 
resuit of experience in learning 


‘abstract concepts. This type of learn- 


Ing appears t. be more in tine with that 
received in higher education than in 
trade skill iearning. Characteristically, 
enalysts who progress to higher skill 
levels have had post-high school edu- 
cation. 


6.2.3 Communication Skills 


Foreign language ts of special impor- 
tance to COMINT and: HUMINT inteill- 
gence production for obvious reasons. 
From a general standpoint, language 
skills are vital to che analyst for under- 
standing the meaning of collected intel- 
ligence even after It Is interpreted. 
Writing and speaking skills are essential 
for the analyst to communicate analytic 
results to clients. 
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Know/ledge of event, situation 
Knowledge of procedure 


Knowledge of judgmental/ 
anelytioal criterion 


Know !"ige of how to get 
(more) information 


- Knowledge of who to ask 
or oall 


~ Knowledge of where to find 
information on: 


event, situetion, 
judgmental /anelytioal 


oriterion 


procedure 


Knowledge of how to eoquire 
information which te not 
avaliable in external memory 





UXTERMAL MEMORY 
UPDATE/EXTENSION 


References, side, 
historical files 


Procedures, tasking inst. 


Figure 6-1. The Analyst's Use of Memory Resources 


6.3 Memory Management Orientation 


The use of information from memory is a 
centrally important factor In Intelligence 
analysis. This includes not only the use 
of: the analyst’s own memory, but also 
the use of extemal memory resources 
avaitable in the extended work setting. 
The three columns of Figure 5-1, to be 
discussed in more detall below, depict 
types of Information contents available 
from internal and external memory, and 
from the functions for 
updating/extending external ..mory. 
The twce-way arrows indicate the 
reciprocal flows of types of Information 


from storage facilities where they are 
availabie to storage facilities where 
they are not. The one-way arrows indi- 
cete the manner in which use of tho 
other two sources of information is 
dependent upon knowledge contained In 
internal memory. 


5.3.1 Knowledge of Events and Situa- 
tions 


Figure 6-1 shows that the analyst 
retains an internal memory store of 
information on situation and current 
events. An imagery Interpreter, for 
instance, may become so familiar with a 
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terrain erea as to be able to detect any 
type of changs that may be signi‘ cant. 
S’.allarty, a SIGINT analyst may be able 
‘vo recognize targets on the basis of 
"personality" characteristics that ara 
not: definable in terms ot recorded sig- 
nature information or signal content. An 
anatyst may also review externai 
memory resources, such 4s situation 
maps, status displays, and message 
traffic files, to provide cues that, 
through mental association, may lead to 
extending an area of search or expand- 
ing the possible interpretations. 


&.3.2 Knowledge of Procedure 


Figure & shows that knowledge of pro- 
cedure resides in internal memory. 
Other than manuals for operating partic- 
ular types of equipment or for format- 
ting products, there ls almost no docu- 
mentetion on the detailed procedures 
used in perforining analysis. Such pro- 
cedures are conveyed ta the analyst 
threugh on-the-job training. The neo- 
phyte analyst generally gains profi- 
clency by working closely with experl- 
enced analysts who provide assistance 
and immediate feadback on perfor- 
mance and answer questions on tech- 
niquas and interpretations. This face- 
to-face iearning relationship is very 
widespread and recognized as essential 
in intelligence analysis. It is referrad to 
by some experienced analysts as the 
“oral tradition” of learning intelligence 
analysis. 


The oral tradition for learning tha pro- 
cedural iIntricacles of intelligence 
analysis emphasizes the importance 
of informal face-to-face communica~ 
tions. 


In this regard, it Is important that the 
analyst develop confidence in the ablii- 
ity to analyze and at the same time 
remain comfortable about asking 


quest'ons of colleagues when uncertain, 
since this process continues to be part 
of many analytic problem-soiving situa- 


‘tions. The shared group value for “ego- 


less" problem-solving axchanges was 
frequently observed. 


6.3.3 Knowledge of Accepted Judg- 
mental and Analytical Criteria 


The priorities and significance of 
analytical results re established 
through cooperation between the intelii- 
gence organization and the client. At 
the strategic level many cf these cri- 
terla are fong-lived. in tactical environ- 
ments, the analyst is frequently 
required to make judgments of changing 
significances and can therefore profit 
from frequently renewed contacts with 
clients, in particular the unit com- 
mander. 


§.3.4 Knowledge of How to Get More 
information 


The analyst nermally works as part of & 
group of co-located analysts who share 
the Intelligence production workload and 
operate as a team-memory resource for 
one another. As indicated by Figure 5- 
1, colleagues are the most immediate 
source of knowledge after the internal 
memory of the analyst is exhausted. tn 
the operation of severaj intelligence 
fusion groups during tactical exercises, 
it was observed that specific areas of 
memory responsibility were designated 
to Individual members of the analytical 
team. An analyst assigned a specific 
content area was responsibie for col- 
jecting, reviewing, and rememberiig or 
maintaining availability of all information 
pertinent to that area, as well as brief~ 
ing the fusion team chief wher neces- 


sary. 


Association with expe’lenced analysts 
is ths major source for gaining 


knowledge of where to find information. 
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Analysts develop contacts from past 
assignments or training courses and 
retain informal communication with those 
contacts. Mission-defined units of 
Intelligence organizations are not large, 
and analysts with wide experience are 
well known in bath tactical and stra- 
tegic settings. 


Most analysts supplement personal 
i memory with a "shoebox" of specific 
‘7 refurencess, kexs, training material, etc., 
which are of use in the particular 
assignamert. There is no obvicus con- 
sistent similarity between the shoe- 
boxes of different analysts. 


Computer data bases, such as those of 
thea DIAOLS/COINS network of the 
Oafense Intelligence Agency, are widely 
accessible in strategic Intelligence 
facilities and are indirectly accessibis 
to tactical unite. These computer data 
bases greatly extend the ability of the 
anelyst to draw on previous analytical 
work and erchival data. 


§.3.5 Knowledge of Collection Capabil- 
ities 


Knowledge of collecticn capabilities fs 
important to the analyst for two main 
reasons: 
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1. To provide judgmenta! criteria 
regarding strengths, {imitations, and 
possible artifactual aspects of 
various collection meaiis, and 


2. To provide realistic knowledge 
about means aveilable for acquiring 
information unavailable {in either 
Internal or external memory. 





In most production situations, analysts 
are isolated from the functions of actu- 
ally planning collection activities and 
managing collection resources. How- 
ever, there Is a growing consensus that 
the generic functions of intelligence 
production and collection management 
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can be »erformed more effectively with 
somewhat closer coordination between 
the two functions. As a result, it is 
sometimes yound advantageous in the 
tactical environment for the intelligence 
analyst to be Involved in development 
of the collection plan at the early 
stages of deployment, and to provide 
continuous feedback on the quality of 
collected data. For example, a SIGINT 
analyst who understands the limitations 
of eli ctronic signal detection has a 
better perspective on the reliability of 
producing regular inteiligence products 
for the commander. Similarly, the {MINT 
analyst who understands the probiems 
of the reconnaissance pilot has more 
accurate expectations of the compiete- 
nesa and accuracy cf imagery missions. 


§.4 Personality Attr’outes of the 
Ideal Analyst 


The attributes of the ideal analyst 
offered by analysts interviewed during 
the course of this project are summar- 
Ized as follows. The ideal analyst: 


e Is a technologist. 


e Is focused (cither a specialist or 
generalist, not both). 


e@ Js an Information entrepreneur (as 
Gcescribed earlier). 


e is comfortable with changing roles 
as epprentice, freer, trainer, or 
consuitant. 


e Can communicese (written and 
oral). 


e is a dotective. 
@ is Imaginative. 
@ Is self-starting/self-organizing. 


e Has a_ profassion (intelligence 
analysis). 
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e Has related hobbies or technology 
’ interests. 


e Prefers analysis to management. 


e@ Can perform multiple, concurrent 
activities. 


@ Is individuallstic. 

e Is self-confident. 
@ Is a historian. 

@ Has a photographic memory. 


This list reflects how analysts feel 

about themselves. Professionalism is 

apparent at all skill levels. The most 

} frequert complaint was that tactical 

unit assignments do not provide an 

active mission or an adequate access 
to rea! data and support facilities to. 
maintain and extend professional skiils. : 
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6. THE COGNITIVE MODEL 
6.1 Cverview 


The cognitive model presented here 
summarizes salected aspects of cogni- 
tive functioning that appear to be of 
central importance to the processes 
invotved In intelligence analysis activi- 
tles. Each aspect has also been the 
object of laboratory verification in the 
field of experimental psychology. 


The cognitive model is un abstract 
description intended to summarize and 
account for behavioral and psychologi- 
cai observations and their relationships. 
The modei serves to describe interre- 
lated processes that occur inside a 
person’s head when performing Inteili- 
gence analysis. Cognitive processing is 
a continuum:--some is superficial and 
some very deep. During superficial pro- 
cessing the individual is sometimes 
aware of the processing and sometimes 
not; during deep processing the indivi- 
dual is sometimes aware of the pro- 


' sessing and sometimes not. Whether 





accomplished within or outside awara- 
ness, cognitive processing is a dynamic 
interplay cf information from the senses 
and from internal memory. 


The cognitive model presented here 
focuses on the flow of information 
through the cognitive "system". 
describes Inputs and processes operat-~ 
ing on those Inputs to produce cutputs. 
The inputs mey come from the external 
world or from internal memories. The 
model as presented does not account 
for all known phenomena or describe ail 
known processes in exhaustive datall. 
It does provide a framework for under- 
standing cognitive processes in intelli- 
gence analysis. 





The cognitive model Is summarized by 
the following three points: 


1. An Individual’s initial cognitive pro- 
cessing of information from the 
environment is conducted within a 
few tenths of a second by mechan- 
inms operating ou‘side the 
indtvidual’s awarenes: (termed 
“automatic” processing.) As dep~ 
icted in Figure 6-1, information 
enters through sense organs (eyes, 
ears, etc.) where it is converted to 
nerve impulses by automatic (out- 
side awareness) processes and 
conducted to the brain. There, an 
automatic process rapidly compares 
the raw sensory [tnformation with 
information patterns aiready stored 
in the individual’s memory. This is 
the COMPARE arrow in Figure 6-1. 


When a gross match is found, parts 
of the raw sensory pattern are 
automatically ; elected because of 
their similarity to features of the 
memory pattern and are combined 
with other elements of the informa- 
tion pattern from memory, shown in 
Figure 6-1 as the CONSTRUCT 
arrow. The resulting pattern of 
combined (information, stilf outside 
awareness, cons jtutas the initial 
version of “meaning" (of a visual 
scene, of a pattern of sound, of a 
tactile pattern, atc.) Thus, all initial 
meanings represent active con- 
structions perfcrmed by cognitive 
processing mechanisms operating 
outside awareness. As already indi- 
cated, such conritructions are ordi- 
narily accomplished within a faw 
tenths of a second. 


2. Many initial meanings remain out- 
side awareness and trigger »at- 
terns of highly practiced adjust- 
ments that are also carried on out- 
side awareness. Automatically 
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Figure 6-1. Cognitive Mode! Overview 


constructed initial meanings form 
the bases for generating uware- 
ness (when awsreness occurs) and 
for the initial selective focusing of 
attention on certain aspects of the 
aware experience. Such 
responses include automatically 
Ignoring information as Irrelevant, 
uninteresting, or completely 
expecied. 


The central cognitive function con- 
sists of a continuous cycling of the 
COMPARE/CONSTRUCT process, 
with each cycle accessing the 
individual’s memory. Each cycle 
causes some modification of the 
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memory-storage structure of the 
particular contents accessed. The 
modification cf meinory occurs 
regardiess of whether memory 
information is used only = for 
automatic processing outside 
awareness or is used also for 
deeper processing at progrussively 
higher levels of awareness (such 
as paying close attention, studying 
a situation, thinking, decision mak- 
ing, and problem: solving.) 


Three main types of information 
modification occur as products of 
the functioning of the basic 
compare/construct precess: 
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@ sensory information filtering, 


memory information consolida- 
tion, 


@ memory access interference. 


Anatysis of an individual's experi- 
ences in terms of these modifica- 
tion mechanisms can provide pred- 
ictions about cognith:s information 
processing behavior to be 
expected from that individual. 
Thus, although individuals have lit- 
tle conscious control over the func- 
tloning of thelr memories and per- 
ceptions, the predictable rdiation- 
ships between experience patterns 
and information modification 
mechanisms can be used to predict 
and control the functioning of 
memory and perception. 


The main cognitive functions just 
described are produced by basic, ele- 
mental processing dynamics operating 
through a structure of underlying cogni- 
tive capacities. 


To summarize: Human cognition may be 
characterized as a set of interrelated 
processes which operate on available 
information. “Analysis” Involves the 
assignment of meaning to incoming and 
previously stored information. The 
descriptive model of analytic behavior 
developed here builds on an under-~ 
standing of some of these basic cogni- 
tive processes to explain analysts’ 
interpretation, storage, and recall of 
information. At a very general level! the 
model describes the dynamic interplay 
between incoming information and previ- 
ously stored information (i.e., internal 
memories). Processes which are cen- 
tral to this interplay are the 
COMPARE/CONSTRUCT sequence and 
the memory modification cycle invoiving 
filtering, consolidation, and access: At 
.@ more detalied level the model 
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uascribes the functioning and imfiica- 
tions of thease processes and underlying 
processing dynamics. 


In the following paragraphs, memory 
modification mechanisms are described 
first, followed by an account of the 
underlying structure of cognitive capa- 
citles and elemental processing dynam- 
ics. 


6.2 information Contents Modification 
Cycle 


The COMPARE/CONSTRUCT processing 
of information depends upon elemental 
cognitive processing dynamics (to be 
described later) which operate continu~ 
ously during wakefulness. The elemen- 
tal aynamics support three /nformation 
modification mechanisms that operate 
on the sensory and memory information 
used by the compare/construct pro- 
cess. Since Information from the 
senses and memory constitutes the raw 
material upon which intelligence 
analysis interpretations and estimates 
are based, the information modification 
mechanisms have important imptications 
for understanding and predicting the 
orientations and nature of analytic 
interpretations and estimates. Figure 
6-2 diagrams the information contents 
modification cycie. 


Sensory Information 


- \ 


Memory Contents 
Consolidation 


Le. Access 
Interference 


Figure 6-2. information Contents 
Modification Cycte. 
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The cycle is composed of three 
mechanisms: sensory information filiter- 
ing, memory contents consolidation, and 


‘ memory access interference, all of 


which are described below. 
6.2.1 Sensory Inf mation Filtering 


The sensory Information filtering 
mechanism is composed of two comple- 
mentary functions: selectivity, and 
generalization. 


6.2.1.1 Selectivity Filtering 


Selectivity mechanisms approach filter- 
ing from the viewpoint of answering the 
question: Which aspects of the raw 
sensory information pattern are signifi- 
cant? The compare/construct process 
outlined in Section 6.1.1 compares the 
raw sensory input for similarity with 
existing memory contents. An adequate 
gross match is usually found quickly, 
and the sensory input is relegated to an 
existing gross mental category. 


Thus, the initial compare/construct pro- 
cess often ignores (passively rejects) 
significant information In the raw sen- 
sory Input that in fact does not fit (at a 
deeper, more detailed level of analysis) 
the mental category assigned to it. If 
the overall first impression of the sen- 
sory Information pattern Is a good match 
with gross features of existing memory 
contents, disparities between the sen- 
sory pattern and the memory information 
pattern at more detailed ievels often 
have no chance to enter awareness. 


Polarization filtering is a variation of 
the selectivity filtering mechanism, in 
which an expectation that has been 
established usually increases the 
accessibility of memory contents 
related to that expectation (i.e., 
memory information related to both con- 
firming and denying it). This produces a 
polarization effect that focuses more 


attention on the features of the expec- 
tation, thus passively rejecting other 
potentially important Information that 
happens to be irrelevant for corfirming 
or denying the expectation. 


Thea polarization effect can bring posi- 
tive results when unfolding events 
correspond to expectations and nega- 
tive results when events are unrelated 
to confirming or denying expectations. 
Polarizing effects are stronger when an 
expectation is implicit (l.e., is unexam-~- 
ined or unquestioned in awa’eness). 
Explicit questioning of expectations can 
reduce polarization. 


6.2.1.2 Generalization Flitering 


Generalization mechanisms approach 
filtering from the viewpoint of answer- 
ing the question: How much and what 
kind of similarities are required to 
recognize things as the same? The 
confident use of knowledge depends on 
being able to generalize from experi- 
ence. Success in applying past experi- 
ence (memory information) to the 
present depends on the validity of geti- 
eralizations employed between the past 
and the present. The effective use of 
generalization is a fundamental and 
inescapapvie aspect of dealing success- 
fully with the world. The elemental pro- 
cessing dynamics and basic capacities 
of the cognitive model (to be described 
later) provide the bases for identifying 
three main types of mechanisms for 
filtering by generalization: tolerance, 
analogy, and fill-in, 


6.2.1.2.1 Tolerance Generalization 


In tolerance generalization, a slot In a 
memory storage frame (see discussion 
accompanying Figure 6-65) Is filled with 
new raw sensory information matching 
that slot. Goneralization can occur 
depending upon the tolerance matching 
criteria of that slot. Since memory slots 
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are organized hierarchically by increas- 
ing levels of detail of information stored 
there, tolerance requirements for 
matching grow more stringent at the 
deeper, more detailed levels of a 
memory slot. Of course generalization 
may be valid or invalid at any level, but 
fooser tolerances increase the chance 
that raw sensory Information is inap- 
propriately generalized. 


The mechanism of tolerance generaliza- 
tion usually operates outside aware- 
ness. Deeper, more thorough cognitive 
precessing that involves more time 
spent in highly focused aware compari- 
gon between sensory information and 
memory Information can prevent some of 
the errors introduced by the tolerance 
type of generalization. 


6.2.1.2.2 Analogy Generalization 


In analogy generalization, comparisons 
of similarity are made between the pat- 
tems of relationships connecting the 
slots of different memory contents 
storage frames. For example, the 


memory information about very different | 


social organizations can be compared in 
order to generate analogies between 
organizational hierarchy structures; or 
memory contents depicting the relations 
between pressure, flow volume, and 
pipe diameter for water can genorate 
analogies to memory contents for the 
relations between voitage, amperage, 
and c- iuctance for electricity. The 
udlt- of generalization by analogy 
depends partly upon the actual rela- 
tional equivalences bet. /een the real- 
world referents for the analogy, and 
partly upon the validity of the infer- 
ences drawn on the basis of assumed 
relational equivalences. The mechanism 
of analogy generalization often 
operates outside awareness. 


6.2.1.2.3 Fill-in Generalization 


in fill-in generalization, missing parts of 
the raw sensory pattern are filied in 
from similar chunks of information in the 
memory frame sfot. {if the reasons for 
missing parts of a sensory Information 
pattern are implicitly understood, 
(either because they are obvious or 
because of insufficient consideration of 
the fact of missing Information), the 
fill-in is often automatic. The results of 
fill-in are advantageous if sufficiently 
correct and disadvantageous if based 
on faulty assumptions. Careful exami- 
nation of assumptions about missing 
data can raise the level of awareness 
used In fill-in processing. 


6.2.2 Memory Contents Consolidation 


Memory contents, including information 
recently passed through the filtering 
process and stored, are consolidated 
(i.e., made more accessible and vivid) 
as a joint function of the frequency of 
processing and the amount of atten- 
tion used in the processing. Thus, more 
frequently encountered, important 
types of experiences upon which signi- 
ficant mental effort are expended 
be :ome more vivid and immediately 
accessible in memory. 


The increased accessibility and vivid- 
ness of particular siemory contents 
increases the likelihood that they will 
be used as_ filtering criteria in 
comparing/constructing future, some- 
what similar raw experiences (versus 
using equally appropriate or more 
appropriate memory contents that are 
less accessible and Jess vivid). For this 
reason the contents consolidation 
mechanism can have important impfica~ 
tions for the accuracy of analytic 
interpretations and estimates. 


If the results of the consolidation 
mechanism match the realities of future 
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events to be interpreted, the effects of 
consolidation are advantageous; if not, 
the effects are a disadvantage. Long 
term static conditions tend to increase 
the favorability of results from the con- 
solldation process, while eras of rapid 
and significant change do not. 


The caricature effect is a type of dis- 
tortion that can result from the process 
of consolidation. Mental rehearsal of an 
experience, rumination about an experi- 
ence, and problem-solving — chinking 
about ai. experience can Increase the 
accessibiiicy and the vividness of the 
particular memory contents related to 
that experience. Given no additional 
external information about a certain 
experience, continued rehearsal, rumi- 
nation, and thought tends to emphasize 
and deemphasize various aspects of 
the memory of that experience. 


The result of emphasis and deemphasis 
Is to “normalize” usual or expected 
aspects of the memory and to exag- 
gerate unusual or unexpected aspects, 
with usuainess/unusualness being 
judged in relation to the rest of the 
overall memory structure. That is, the 
consistency or usuainess between 
some of the contents of the particular 
memory an the balance of memory con- 
tents may be exagger. ted beyond thelr 
original consistency, and the disagree- 
ment and inconsistency in other parts 
of that particular memory may also be 
exaggerated beyond their origina! con- 
dition. 


Since the combined results of these 
processes tend to produce a memory 
that Is a caricature of the original con- 
tents, the result has been termed the 
cericature effect. This effect tends to 
feed on the elements of unusualness 
and surprise and to overwelgh these 
elements as compared to the more 
expected elements of experience. If 


the situation is such that novel ele- 
ments of an experience are accurate 
portents of a future similar event, the 
caricature effect may provide help in 
interpretation when it arrives. if not, 
1e caricature effect can be an impedi- 
ment to accurate Interpretation, espe- 
claily If the interpretation must be 
based on Incomplete data. 


The cericature effect is a special "no 
new information" version of the consoli- 
dation mechanism (the latter being 
based on repeated instances of a cer- 


tain pattern of external experience). 


Since the caricature effect depends 
partly on the experience of initial 
surprise followed by a situation favoring 
the intensive use of unshared and 
unexamined rehearsal and rumination, 
the conditions for predicting and con- 


trolling the caricature effect are at . 


present only partially understood. 
6.2.3 Memory Access Interference 


Memories for very similar experiences 
can interfere with one another during 
memory access, slowing access and 
making it fess reliable and fess accu- 
rate. (As Indicated in the diagram of 
the modification cycle, such interfer- 
ence can have strong effects on the 
memory Information available for the 
filtering stage of the next cycle.) The 
two main interference effects can be 
termed the intervening similarities 
effect and the similarities saturation 
effect. 


6.2.3.1 intervening Similarities 
Effect 


The requirement to access a memory of 
an earlier avent may be either of two 
types: requirement for recall or 
requirement for recognition. 


@ Recall consists of, for example, 
responding to the question "What 
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kinds of vehicles were present in 
the Imagery you viewed before 
lunch yesterday?" That is, recall 
consists cf accessing memory 
contents for a focus of attention 
of an earlier axperience, based on 
receiving a name or description of 
the situation within which that 
facus of attention was experi- 
enced 


@ Recognition consists of, for exarm- 
ple, responding to the question "Is 
this frame of imagery one of those 
that you viewed before lunch yes- 
terday?" That Is, recognition con- 
sists of accessing a memory for an 
earlier situation within which 
currently presented specific infor- 
mation was experienced as the 
focus of attention. 


For both recall and recognition, highly 
similar experiences that have inter- 
vened between the original experience 
and the current requirement for memory 
access tend to interfere with the 
accessibility of the original memory 
material; the /ntervening similarities 
effect creates interference with 
memory access for both recall and 
recognition. Thus an analyst processing 
many messages of very similar contents 
from the same domain, under constant 
conditions ani over an extended period 
of time, is unlikely to be able to recall 
the specific messages processed dur- 
ing a certain period of time. Also, the 
analyst may not be able to recognize a 
specific message presented for re- 
examination as having ever been pro- 
cessed. 


When the intervening similarities type 
of memory access Interference must be 
circumvented and can be anticipated, 
recourse to external memory aids Is the 
only currently effective solution. 


6.2.3.2 Similarities Saturation Effect 


Concentrated repetitions of high'y simi- 
jar experiences cause proliferation of 
many highly similar memory contents in 
related areas of memory. The 
increased difficulty of comparing across 
and discriminating between many similar 
memories cause® r2cicec speed and 
accuracy In the compare/construct pro- 
cessing of each new related experl- 
ence. It also interferes with rapid and 
discriminable storage of the similar new 
expe lences in memory. 


‘ The similarities saturation effect can be 


lessened by providing the Individual a 
chance to refocus attention on dif- 
ferent memory contents for a period of 
time, thus allowing the _ interfering 
memories to become less vivid and less 
Immediately accessible. When the 
recovery phase has been accomplished, 
capacity Is again available to learn new 
discriminations In that area of memory. 


The intervening similarities and similari- 


tlea saturation form: of Interference 


with memory performance are predict- 
able cognitivo mechanisms of informa- 
tion processing. They operate to 
weaken and diffuse the information 
available from memory by affecting the 
speed, reiiability, and accuracy of 
access to memory contents. As indi- 
cated by the diagram of the modifica- 
tion cycie, such weakening and diffu- 
sion can changs the pattern of memory 
contents that will be used as filtering 
criteria for the next cycle of experi- 
ence and memory modification. , 


To summarize: Memory contents sub- 
stantially determine the  individual’s 
automatic responses to, as well as 
aware experience of, new information. 
At the same time, the functioning of 
memory and of perception is not under 
tha direct conscious control of the 
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individual. Nevertheless, three poten- 
tially predictable and controllable cogni- 
tive mechanisms operate in a cycle to 
modify information contents availiable 
from memory. Since memory contents 
provide a large portion of the Informa- 
tion used in making many Inte'ligence 
analysis interpretations and estimates, 
the information contents modification 
cycle is an important concept for sug- 
gesting ways to improve intelligence 
analysis. 


As part of this cycle information is til- 
terad, consolidated and otharwise modi- 
fied. Selective filtering may operate to 
ignore (filter out) aspects of Information 
that are disparate froin stored informa- 
tion. Polarization, stemming from 
expectations that have teen esta- 
blished, may increase the chance of 
processing Information that would oth- 
erwise have been fiiterad, but it may 
also lead to filtering of other Information 
not directly related to confirmation or 
denial of the expectancy. Generaliza- 
tlon is an important mechanism which 
operates during the filtering process. 


information which has passed from the 
senses through the filtering process is 
consolidated with preexisting informa- 
tion contents. The consolidation pro- 
cess provides a higher degree of 
access to information frequently called 
upon. However, K also may lead to 
various distortions of the information. 
Memory access Is also affected by the 
structure of memory (the relationship cf 
various kinds of information In storage). 
Attempts to recall (remember) informa- 
tion frequently encounter interference 
rasulting from unavoidable confusion 
with similar information. it should be 
noted that these e'Yects may be due to 
distortion during ti. Initial storage pro- 
cess (the information was never stored 
as a discriminabie item) or during ths 


retrieval process. 
6.3 Structure of Cognitive Capacities 


The structure of basic cogn'tive capa- 
citles consists of informaticn storage 
and routing facilities and their relation- 
ships, while the elemental processing 
dynamics consist of mechanisms for 
transforming liformaticn as it flows 
through the basic structure. From left 
to right, the column headings of Figure 
6-3 depict the main components of ihe 
cognitive structure and their relation- 
ship to the analyst environment (the 
extended work setting): 


1. Analytic Work Setting, including 
External Memory 


_ 2. Analyst’s Senses 
3. Analyst's Sansory Buffer - 
4. Anaiyst’s Processor Structures 
6. Analyst’s internal Memory 


Each Is described briefly below. 


4 


6.3.1 Analytic Work Setting and Ene. 3 


nai Meinory , ‘ 


Column 1 of the diagram In Figure 8-3 
depicts the work setting, whic con- 
tains many information channels ‘if “hy 
kinds shown in Figure 4-1. Infor :vation 
may be available through media suvh as 
face-to-face or telephone ca:‘versa- 
tions, printed materials, computer-based 
displays, etc. 


6.3.2 Senses 


Various senses (vision, heart: tou:sh,) 
in column 2 are the means dy \hich all 
information from the environine 1. anters 
the cognition of the analy,;t. Each 
sense type can be distinguist ic’ by its 
receptor organ, the typa of eyZerlance 
produced by the sense, the type of 
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Figure 6-3. Cognitive Structures and Informetion Flows 


physical energy to which the sense 
organ responds, and the Iinformation- 
cerrying capac'ty of the sense. 


6.3.3 Sensory Buffer 


This capability (depicted in column 3) 
accepts raw information from the 
senses and makes it available to the 
rest of the cognitive structure, wile at 
the same time preserving the informa- 
tion for a short time after cessation or 
change In the sensory input. The buffer 
has several characteristics: 


@ It cperates Iike 2 "push-through*" 
store: New information from the 
senses replaces or forces out 
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older information after a certain 
(small) accumulation in the buffer 
has been reached. 


There is partial parallel storage 
for different senses: Traces for 
very recent auditory, touch, or 
muscular senss inputs outside 
awareness and attention can be 
recaptured by shifting the current 
focus of attention from, for exam- 
ple, the visual to the auditory. 
(The reader may be able to recap- 
ture unnoticed recent sounds.) 


Storage life /s very limited: From 
one-half to two or three seconds 
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is typical. 


e@ It may be “commandeered”: Large 
changes in stimulus Intensity for 
one type of st'nulus can "swamp" 
the buffer capacity and momen- 
tarily eliminate the traces of other 
types of stimull from the buffer. 


@ Suffer contents are OUTSIDE 
awareness: Buffer contents nor: 
mally enter awareness only after 
they have been 
compared/constructed with con- 
tents from memory (l.e., are made 
meaningful) and often not even 
then. Thus, the focusing of 
attention (the choice of which 
sensory channel and material to 
attend to), is often accomplished 
outside of awareness. That is, 
tha focusing of awareness and 
attention is accomplished both by 
processes within and processes 
outside of awareness. 


6.3.4 The Procassor Structures 


Column 4 of Figure 6-3 _ contains 
COMPARE/CONSTRUCT processes which 
Operate to transform the information 
flowing from the sensory buffer to the 
memory, and to route it back to the pro- 
cessors. Three processor str tures 
are shown. The 


1. Awareness and Attention Processor 
generates awareness and attention 
' for Information that flows through It. 
Conversely, all information flowing 
cutside this processor Is outs Je 
the individuel’s awareness and 
attention, and thua Is processed by 
the: 


2. Outside Awareness Processor which 
has a larger capacity than the 
awareness and attention processor. 


3. Executive Actions Processor sup- 
ports the production of external 
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behavior. 


These three processors combine their 
functions to produce: 


1. External behavior within individual's 
awareness. 


2. External behavior outside 
Individual’s awareness. 


3. internal, unobservable behavior 
within individual’s awareness. 


4, Internal, unobservable behavior 
outside individual's awareness. 


6.3.6 Memory 


Coiumn 6 represents the  overail 
charactoristics of human memory as it is 
usually understood. It is critical to an 
understending of human memory and of 
cognitive processes to realize that 
memory and thought are highly struc- 
tured. Without categories and con- 
cepts, an Individual would be unable to 
deal with Incoming and stored data. A 
major aspect of the cognitive model, 
then, Is the structure of memory, 


e There ‘is a high degree of 
correspondence between the 
categories of information available 
in the work setting and the 
categories of information in 
memcry. 


@ For each category of analytic- 
relevant information cuntained in 
storage memory, there is also 
corresponding memory information 
indicating the availability (or lack 
of) supplementary information of 
the same category in the work 
setting. 


e The accessibility of contents of 
memory varies with respect to 
speed of access, reliability of 
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access, and level of detail of 
information available. The overall 
dimension of accessibility Is dep- 
Icted In the diagram by the scale 
shown at the bottom of column 6. 
Highty accessible contents are 
depicted as “closer” to the pro- 
cessor structures thet will use 
them. 





re 
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@ Memory contents vary with 
respect to the amount of time 
they have been in_ storage. 
Although storage times are on a 
continuum, memory researchers 
have found it convenient to desig- 
nate recently stored and/or 

; recently accessed and re-stored 

contents as being in “working” or 


See ee see, ee ee 


medium-term memory. Contents 
with fong storage lives and less 
recent accesses and re-storage 
are designated as in “long term" 
memory. 


e@ The amount of information poten- 

- tially available from long term 
memory is much greater than in 
working memory. On the other 
hand, as ind'cated by the accessi- 
bility scale in the diagram, the 
information in working memory is 
more accessibie than that in long 
term memory. 


The storage structure of memory |s unl- 
form across its working and long term 
portions and across all categories of 
contents. The structure is bulit up from 
“chunks" of experience that are fitted 
into the “slots" of memory "frame" 
structures, as follows: 


e An experience is organized as an 
instance of a type of something, . 
occurring within an /nstance of a 
type of background setting (i.e., 
organized as instances of "figure" 
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and “ground"); for example, a 
truck figure in a camouflaged 
position background or a division 
figure in field maneuvers back- 
ground. The figure and the ground 
can be thought of as two gross 
“chunks” Into which the experi- 
ence is divided. Figure and ground 
chunks are often further divided 
and expanded into chunks at 
greater levels of detail (analogous 
to the effect of « zoom lens in the 
visual realm). 


The storage structures of memory 
consist of frames, each composed 
of a pattern of slots connected by 
links. Each slot represents a cer- 
taln category of experience 
chunks already stored in memory 
and Is organized hierarchically by 
Increasing level of detail of the 
experience chunks stored in it. 
The examples in Figure 6-4 pro- 
vide phrases describing informa- 
tion category chunks stored in 
memory frame siots, with proyres- 
sively more detailed chunks at 
lower levels in the lists. 


A link In a memory frama is a spe- 
clal kind of slot that represents a 
certain type of relationship. For 
example, possible relationships 
linking two slots designated A and 
B would be: 


A: is part of 8; succeeds B; 
occurs with B; implies B; is a 
subclass of B; is a functional 
equivalent of B; Is synonymous 
with B; Implies NOT B; was 
acquired with B; Is associated 
with B; A and B are: parts of C; 
subclasses of C; etc. 
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VISION 


Vehicle 
Tracked vehicle 
Light tank 


Topside 
Turret 
Turret hatcn 


HEARING 


Moving vehicie sounds 
Tracked vehicle sounas 
Particular motor sounds 
Particuiar track sounds 
Combined Tank sounds 
Sounds of Specific Tank 





Figure 6-4. Example: Hierarchies of information Storage Chunks 


Thus, both slots and links are 
ceiegories of experience chunks 
alreedy stored in memory, the 
categaies each having a toler- 
ance limit for accommodating simi- 
lar new chunks of experience. 
Each new experience is 
represented as an “instance” of 
the category, with content varia- 
tions appropriately appended. 


e The contents of memory ara out- 
side awareness until they are 
accsssed by the swarsness and 
attention processor. Ordinarily, 
when being accessed by the 
awaraness end attention proces- 
sor, the chunks at various leveais 
of detalii in a memory slot are 
“opaque" to one another; f.e., two 
different levels of detail from 
memory do not occusy awareross 
aimuitaneously. 


Figure 6-5 diagrams an example of a 
memury frame. Each of the two-way 


arrows represents a link betweun a pair 
of figure-in-ground slots. While all pos- 
sible relationships between siots have 
been depicted ia the diagram example, 
many potential rei:tionships between 
slots in actual memory frames may be 
non-existent. The contents of slots in 
the example were selected somewhrt 
erbitrarily from a larger set of possitill- 
ties, to help shed light on the concept 
of a memory frame, as follows: 


Time locefe slot: stores a time 
trace organized in terms of 
“before and efter" relationships 
batween chronoicgical anchoring 
points for significant events, and 
being more fine-grained for recent 


experience. 
Sensory slot: Often rontains vague, 
general chunks fer sensory 


experiences of vision, hearing, 
touch, taste, etc.; this is espe- 
clailly true in cases of more 
abstract experiences involving 


- 6-12 - 





OL, ketaithame satiate, ddl onccded, EARLS, anc AR a 


| 
! 
a 





j 
1 


halter 


Sanne Ente Soe aS 





DIESE | 


a 


a; 
BN 


bs 





we ame a a oe Re ere 


RRR rene 


eget 


BEHAVIOR 
PRODUCTION é 
SLOT 


SO OC ome REE BEB 
- ERT PTY CANT BT 
ESE DESSERT SEL, OE TRYST 





AFFECTIVE/ 
VALUATIVE 
SLOT 


4 CATEGORIES/ 


RELATIONS 
SLOT 


Figure 6-6. Example of Memory Frame Structure 


information communicated via 
languagsa or other symbols. On the 
other hand, the memory of, for 
example, a personally expeari- 
enced motorcycle accident may 
include vivid senscry chunks in 
that memory storage siot. 


Valuative/affectivs slot: Centalins 
chunks representing vaiue conno- 
tations such as goodness or bhad- 
nass, strength or weakness, and 
dynamic or static, as weli as omo- 
tlens such as affection, anger, or 
fear. 
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Linguistic categories/relations 


slot: Contains chunks representing 
finguistic/semantic descriptive 
categories and relations. Experi- 
ences originally conveyed via 
language and other symbols, and 
experiences that the individual 
has talked or written about, are 
more likely to have vivid material 
readily accessibie in this slot. 


Process pattern siot: Contains 
chunks representing "process 
phenomena" in which the particu- 
lar linked Instance of experience 
Is understood as one step of 
stage of a larger, time-distributed 
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process not directly experienced 
in the altuation. The chunks in 
process pattern slots are a main 
scurce of expectations. 


Behavior production slot: often 
contains Iittie or ne material. In 
Instances whera a type of experi~ 
ence demands external behavior, 
a chunk residing in this slot pro- 
vides the outlines of "plans" for 
producing the required behavior. 


Memory frames are the basic bullding 
blocks for higher-order storage struc- 
tures of memory: 


e@ A frame may opeiate as a slot in 
enother frame. 


@ Guperframes (systems of frames) 
Gevelop, which systematize the 
aturage of experience in terms of 
consistencies based on siriliarities 
between frames az well as other 
types of relationships between 
ther. 


To summarize: Raw Informaticn from the . 


sense organs flows through the sensory 
buffer where It Is retained only tong 
enough to be accepted by the 
COMPARE/CONSTRUCT processes, initia! 
phases of witlch operate outside 
awerenese. These processes rapidiy 
and automatically COMPARE the Infor- 
mation Input with patterns of information 
already stored in memory, and COK- 
ETRUCT a meaning (a response) from 4 
combination of the input and memory 
imuenation. The initial construction of 
meaning takes place outside awareness 
within tanths of a second. The meaning 
may then be used to elicit actione, it 
may cbhtrude into awareness and drive 
thought processes, it may remain out- 
side awareness and result in automatic 
adjustive reactions, or any combination 
of these. : ‘ 





Memory may be conveniently divided 
into ae “working* memory, which stores 
current information for shurt durations, 
and "long-term" memory. Infornation in 
both parts of memory Is stored in pat- 
terns called trames, which consist of 
slots, nodas, or chunks connected by 
links. The information in slots is 
arranged hierarchically by level! of 
getall and specificity. The information in 
links represents tyyves of relationships 
that kold be*ween the information con- 
tained in tha slots. A frame may 
comprise a siot in a larger, more incor- 
porative frama, thus allowing fer very 
complex memory structures to ‘e 
developed. 


6.4 Eiemantal Dynamic Precesses 


A brain trace representing an experi- 
ence chunk exists in the form of a 
neural code; colors and sounds them- 
selves du not exist in the brain but are 
represented there. neuruchemically. 
When stored !:i mamory, the Information 
represented by such a code /s dormant. 
vwnen a trace representing a chunk in 
memory is activated and tho informaitiori 
represented by tho trace is used in 
praceseing, the action is referred tc as 
decoding tha memory trace. Con- 
versely, when an fiatance c! an experl- 
ences chunk {3 stored in memory in the 
form of inactive brain traces tha action 
ia referred to as encoding the axperi- 
ence. Matching is comparing trace 
godes for similarity. A match Is an 
‘dentified simitarity betwoen codes. 


The basic compare/construct process 
described eerlier (see Figure 8-3) is 
made up of mors elemental dynamic 
processes consisting of a behavioral 
sequence ov matching, Jocoding, 
matching, and encoding steps (MDME 
for Match Decode Match Encode). The 
MDME processes cperate on the infor- 
mation flowing from the sensory buffer 
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to the memory and back to the proces- 


structures. In brief, in the MDME 


sequencs, sensory information in the 
form of neural impulses Is: 


matched. grossly against mamory 
information. The memory informa- 
tlon activated as groealy similar is 
then 


decoded to a depth sufficient to 
ensure the degree cf secondary 
match necessary in the particular 
situation. This compare/construct 
piocess produces a new configur- 
ing or “chunking” of information, 
which Is 


encoded in the form of new pas- 
sive brain traces. 


The newly constructed chunk of 
inforzetion also flows to other 
parts of th. cagnitive structure in 
the fcerm of a Decoded Memory 
Return (DMR). The OMR may flow 
to thea awaraneso and attention 
Processor where It may program 
external behavior within awareness 
and/or match end decode other 
memory contents, including aware- 
ness cf "no signiticant change." 
The awareness processor has 4 
limited information processing capa- 
ality, and can focus clore attention 
on only one level of detail of an 
experience at a time. 


im thought and problem solving, the 
DMR often originates in cognittys 
activities stimulated by memory, 
contents rather than by Information 
from the sensory buffer. 


The DMR aay also fiow to the exe- 
cutive actions processor, where it 
operates, in coordination with other 
behavioral! plans inforination from 
memory, to program patterns of 
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actions processor may operate in 
conjunction with the awareness 
and attention processor to provuce 
aware, deliberate forma of external 
dehavior. More commonly, however, 
the exacutive actions processor 
operates outside awareness to 
produce automatic external 
bahavior in response to DMRs. 


Under apecial conditions, raw infor- 
mation from the sensory buffer may 
momentariiy force Ita way inio 
awareness before being processed 
through memory by the MDME 
processes. As 4 rasuit, there Is 
momentarily no DMR, and the raw 
sensory infcrmation is therefore 
experienced as meaningless. 


7. 


To summarize the MDME processes; 
Several points for application to discus- 
sions in the chapter following can be 
drawn: 


2 The awareness/attention proces- 
sor has a ‘imited capacity com- 
pared to MDME processes operat- 
ing outside awareness. 


@ All ingormation In normal awareness 
has been filtered and filled in from 
memory contents by procegses 
usually outside awereness. 


@ Sensory data from the externa! 
world has no meaning unless fil- 
tered and filled in from mamory 
contents by processes operating 
initially outside the Individual’s 
awareness. 


@ Factors that form and contro! sen- 
sory perceptions and attention are 
mostly outside the individual's 
control. This is also trie of 
rememboring and thinking; Indivi- 
duals cannot force thelr thought to 
contain exactly the desired con- 


Be na AML RD 


axterne! behavior. The executive tents. 
- 6=1 6 - 
aii is lice 5 inti imma TOR Ne ee ras veaatban oak: eet eee esse cba coca 











q 
i 
: 





gota etiieavese cease 


See ee eee Ee EE eT Se Ea Se a Re ape erga ees Saips peerg eget ht Ned x 7 
Aad BS ? FES TIEN | SUNT ETS ARREST TE, CTT SEE TE SS TEE TT Te ITT T SE OTHLET I TN ETT TIT ONS SBR TY RTT A s 





To summarize the cognitive model: 
Memory contents substantially deter- 
mine the  individual’s automatic 
tasponses to, as weil as aware experl- 
ence c!, new information. At the same 
time, the functicning of memory end of 
perception is not under the direct cons- 
cleus control of the = individual. 
Nevertheless, three potentially predict- 
eble and controllable cognitive mechan- 
isms operate in a cycie to modify infor- 
mation contents availabia from memory. 
$'nce memory contents provide a large 
portion of the information used In making 
many intelligence analysis interpreta- 
tione and astimates, the information 
contents modification cycle is an impor- 
tant concept for suggesting ways ‘to 
improve intelligence analysis. 


Memory contents are stored hierarchi- 
cally by level of detail, with gross 
features and outlines of information at 
shallower, more accessible levels of 
storage, and fine details at deeper iev- 
als. A central compare/construct 
mechanism matches incoming raw sen: 
aory inputs to similar memory ccntents 
and actively constructs a compasite 
return which drives behavior and 
experiance. The compare/construct 
mechanism also matches inputs from 
cne part of memory with those from 
another, thus allowing thought and prob- 
lem soiving without external stimuli. 
The basic memory storage fraine striuc- 
ture composed of slots and links ailows 
for very flexible, complex storage 
st-uctures comprising super-frames and 
memory systems. The strategies «and 
judgmental criteria used by the action 
executive processor and the aware- i 
ness and attention processor are them- , 
3tves composed of contents from com- 
plex memory structures. 
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7. THE COGNITIVE MODEL IN THE ANA- 
LYTIC WORK SETTING 


This section reviews the results of sur- 
veying the analytic work settings in the 
light of the cognitive model just 
presented. 


7.1 Special importance of Memory 


A main theme of the cognitive mode! Is 
that, in normal psychological functioning 
In everyday environments with “ideal” 
outside information, the balance oi 
Information used from memory and 
r‘eelved from the outside favors 
,.8no7y much more than casual obser- 
vation would lead one to suspect. In 
many kinds of intelligence analysis, this 
balance is tipped even further toward 
use of memory by the conditions of 
these environments; analysts rarely 
have what they would view as ideal 
data coverage of the objects of their 
Interpretations. 


Often information from memory provides 
the sole basis for hypothesizing sela- 
tionships among data available for 
interpretation and for classifying vari- 
ous data as_ relevant, redundant, 
present, absent, or crucial for the Inter- 
pretive task. Highly confident classifi- 
cations of data value can be made only 
in hindsight, since it fs the unique 
nature of the object or event inter- 
preted that finally determines such 
classifications. Information modeis, 
(models couched in information descrip- 
tive terms, and derived from the more 
general conceptual models defined 
earlier) provide some aids for classify- 
ing available data prior to actual 
interpretation, but at best serve merely 
as guidelines, and sometimes even mis- 
guide analysis. The analyst is left with 
tha on-the-spot task of dynamically 
classifying much of the data presented 
for Interpretation. 


7.2 Awareness of Memory Function 


Often we are not aware that Information 
we are using is coming from memory. 
Memory information used at even high 
levels of awareness does not neces- 
serily obtrude into awareness labeled 
as “information from memory." Figure 
7-1 provides a simple Iiiustration of this 
phenomenon in an example of contribu- 
tions of memory to the task of identify- 
ing a military vehicie masked by a tree. 
Visible parts of the vehicle provide the 
cues for matching and decoding memory 
contents and reconstructing the visu- 
ally missing parts of the vehicle. As the 
fill-in is accomplished, the image of the 
tree is effectively dimmed or even 
erased from consideration. At this point 
the tree is down-graded or eliminated 
from awareness, and a “camouflaged 
tank retriever" is confidently reported. 
The fact of using information from 
memory for fill-in is usually dismissed or 
not even noticed. The same sequence 
of data occlusion, fill-in, and dispensing 
with the fact of occlusion and fill-in 
occurs continuousty for conceptuatly 
more complex and subtie forms of 
experience associated with analysis. 


7.3 Memory Aids and Memory Load 


The information resources and variabies 
In analytic work settings are usually 
quite complex (see Figure 4-1). The 
joads imposed on internal memory are 
fessened by external memory aids such 
as maps, reference materials, and com- 
puter displays. Such external aids 
have advantages. The externalized 
information models they contain (tem- 
plates, doctrine, IPB, etc.) usually 
suffer less from memory modification 
and judgmental distortion factors than 
models stored in the analyst’s cognitive 
memory. Cur -ntly, however, such 
materials ars custly to produce, 
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Figure 7-1. Example of Occlueion and Fill-in 


slow to update compared with the 
analyst’s internal storage memory, and 
usually provide only a partial match with 
the realities toward which they are 
almed. 


Apart from the potential analytic value 
of momory-ald materials, their proper 
handling and use can pose memory 
problems for the analyst. Passive ver- 
sions of such supports, which must be 
remen.cered and searched out to be of 
use, can tax an analyst’s memory in 
fucating materiais. Active versions of 
such supports (such as alarms, forced 
displays, flashing prompts, rigid rem- 
inder schedules, etc.? creete 


interruptions, distractions, and pro- 
cedural overload, by diverting the 
analyst’s iimited-capacity awareness 
and attention processor. This is more 
ilkely when it is being used for desp 
processing of extensive stored inter- 
mediate resuits (problem-solving 
thought). 


7.4 Decision Pressure 


Analysts must us» part of their: memory 
an.! processing cepacity resources to 
plen and manage thelr own work 
behavior. Knowledge about work plan- 
ning and management is also part of the 
analyst’s internal inemory resources, 
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which imposes memory load when used. 
The analyst must. use  availabis 
resources of time end information wisely 
to obtain the best interpretations and 
estimates possible under given cir- 
cumstances. No static formula Is evail- 
able for planning the proper use of 
resources in gach new situation; many 
considerations for intelligence analysis 
are unique to each situation, and deci- 
sion making about related cognitive 
information processing activities must 
accordingly be dynamic. 


Moat centrally, the analyst must 
repeatedly decide when the point has 
been reached where the results of 
each analytic endeav:. a: 7 ficiently 
clear to warrant no *..cthis: .:x penditure 
of analytic resources u: %:> tie current 
conditions of -s%s0urce:: availability. 
Situation?’ variavies that focus pres- 
sure on such decisions include: 


@ Amount of ambiguity and uncer- 
tainty In the data arid In memory. 


@ Possible losses or penaities asso- 
‘clated with a serious error of 
intarpretation. 


e@ Amount of error reduction possible 
ff more data and analytic 
resources could be appiled to the 
interpretation, 


@ Limitations on applying more ana- 
lytic resources, including time, to 
the interpretation. 


Analytic situations involving graat ambi- 
guity, large possible penalties from 
error, great potential for error reduction 
with more processing, but severe limits 
on more processing can cause great 
decision prassure. Under such clir- 
cumstances, typicai decision bebaviors 
include: 


@ Fixation on isolated aspects of the 
situation rather than a balanced 


attention to all parts. 


e@ Excessive osciiiation in choosing a 
final interpretation. 


e@ Lowered predictability and orderii- 
ness in final interpretive choices 
(“leaps" rather than logical 
steps). 


Certain arrangements en procedures 
observed in analytic work settings can 
function to forestall decision pressure, 
to insulate the analyst from it, or to 
constrain behavior under pressure. 
These Include: 


@ Step by step task guidelines for 
data-handiing. 


e Checklists and templates to help 
channel thinking. 


@ Altocation of resources and task~- 
Ing Instructions provided by 
management. 


e@ Discussion and exercises con- 
cerned with: 


~~ The recognition of decision 
pressures in a situation. 


— The techniques for redictribut- 
ing analytic load, if that can 
help. 


— The uses of accountability pro- 
_Cedures as checks. 


— The uses of consulting and 
consensus among colleagues. 


Of course, each of the items listed 
abovs also serves other purposes 
besides lessening the effects of 
decision pressure. Decisicn pres- 
sure as a phenomenon Is recog- 
nized with different degrees of 
exphsitness in different work set- 
tings, but the probiem of lessening 
the pressure is rarely approached 
on an explicit systematic basis. 
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7.6 Memory Resource Management 


Concerns of management and analytic 
personnel about the management of 
memory resources are refiected in many 
field activities: 


e Controlling anatyst’s expectations 
about the most likely meanings of 
forthcoming data. 


@ Assigning analysts limited needs to 
know that are not related to secu- 
rity requirements. 


@ Planning and maintaining coverage 
and backup for team members’ 
current knowledge and skills. 


e@ Planning and maintaining feedback 
on accuracy of analytic perfor- 
mances. 


e Improving the quality and avallabil- 
tty of external memory supports 
and aids. 


Although the Importance and impact of 
the reliability and quality of memory 
functions (versus the reliability and 
quality of data) is occasionally 
remarked, the magnitude of this impor- 
tence as shown by the cognitive model 
is usually jess clearly grasped. 


7.6 Team Memory 


An external memory resource widely 
used by analyste--especially under try- 
ing clircumstances--is the “team 
memory" represented by colleagues. 
Colleagues have advantages as exter- 
nal memory supports because: 


@ query formulation is compara- 
tively easy; a colleague can not 
only provide information, but can 
help the analyst define a need 
and frame a query in terms under- 
standable to the colleague. 


e rapid response is available; a col- 
league can quickly indicate 
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whether or not any help can be 
expected. This allows the analyst 
to search widely in a short time if 
necessary. 


e rapid update of colleagues’ 
memory contents can be achleved 
under some conditions for which 
materlals-based memory support 
systems may require considerably 
more time for update. 


e self correction of external 
memory resources is somewhat 
automatic since colleagues tend to 
recognize their memory shortcom- 
Ings and try to correct them. 
Materials-based memory support 
systems could, in principle, be 
designed this way, but such sys- 
tems are not likely to be realized 
in the near future. 


@ active problem solving by coi- 
leagues Is frequently included as 
part of the team-memory sarvices 
to one another; relevant memory 
contents are not only located and 
communicated, but also compared, 
placed in contexts, evaluated, and 
conclusione are drawn. 


Colleagues can be disadvantageous as 
external memory supports because: 


e disruption of colleague tasks is 
often an inescapable result of 
using team-distributed memory. 
The avaiiability of tean- 
distributed memory cannot be 
guaranteed under conditions of 
high organizational work load, 
unless extra personnel have been 
planned for such functions. 


a Fou: 








ve ae eenneet ster PACA TRENT RNG 


RR Ta TTB 


Sere 


2 wee ere 


ET TT ee 





Ten nee com ro re 








TRUCK 


Figure 7-2. Examples of Shared (Equivoca!l) Data Patterns 


7.6.1 Disparity Analysis A neceseary 
part of the team memory approach is 
the analysis of disparities between 
interpretations supplied by Individuals 
with different backgrounds and 
viewpointe. Objective "ground truth” 
about real world situations (as distinct 
from exercise or laboratory situations) 
is rarely availabie, even historically, and 
never curing the actual task of 
Interpretation. Therefore the analysis 
of disparities between different 
interpretations remains a fundamental 
technique for evaluating Interpretations. 
Aithough comparisons anong different 
interpretations is usually the only 


means available for checking ‘the 
souncness of Interpretations, disparities 
among difterent Individuals’ interprata- 
tions of the same data rasult from 
differences in memory contents. 


The presence of enuivocal data Is mest 
ofteis the oondition that prompts dif- 
ferent ind’vidials to produce disparate 
interpretations. This point is Illustrated 
by Figure 7-2. ‘he top two ovals in the 
figure show that a tank and a heavy 
truck have certain shared attributes (at 
the visual, auditory, and ground sensor 
javeis). if only these shared attributes 
sre available in the data to be inter- 
preted, the data sre equivocal 
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regarding tanks and trucks. in that 
case, elther interpretation can be made, 
and the Interpretation produced will be 
controlied by the analyst’s current pat- 
tern of accessible memory contents. 
The figure also depicts the same 
phenomenon applying to information 
about larger, more complex realities. 


7.7 System Aggregation Models for 
Data and Concepts ‘ 


Related to the team functioning con- 
cept, but distributed over a wider sys- 
tem domain, are the continuing change- 
induced tasks of reapportioning func- 
tions for agyregating data and concepts 
at various points In the system. Data 
selection, aggregation, and conceptuall- 
zation practices within an analytic work 
setting are developed on the basis of 
curront fastors such as technical skills, 
levels of corzeiation and fusion func- 
tions, standing aes for the interpretive 
products (targeting, ENSIT, IPB, plan- 
ning, operations, etc.), and special, 
cllent-targeted, information packaging 
requirements. These arrangements 
develop out of the necessity cf the 
division of work within the system and 
refiect experience with roquirements, 
conditions, and capabilities at various 
ptacee in the organizational network. 


The resulting patterns of memory usage 
and modification in each type of work 
setting create systems of mamory 
frames (superframes) that constitute 4 
typical “view of the world" from the 
vantage point of that setting. Indica- 
tions cf such different views appear in 
answers to such questions as: Hiow do 
you perceive most data (eyes, ears, 
etc.)? What kinds of mental images do 
you use in your work? How many dif- 
ferent pleces of information must you 
typically bring together to make your 
interpretation? Typically, how many 
alternative interpretations for the data 


’ ‘ 


will you entertain me::ially. How large 
a geoyraphical area will typically be 
occupled by 4 phenomenon to be intar- 
preted by you? What is an average 
span of time over which an interpreta- 
tion made by you can be expected to 
remain in correspondence with the 
real-werld objects or events? Such 
specialized viewpoints are an integral 
part of the efficient performance of 
analytical work In the various settings. 


The necessarily different work-oriented 
world views of ditferant settings can 
create interferences in_ information 
passing between settings and can com- 
pourid probiems of analyzing the dispari- 
tles between irterpretations from dif- 
ferent settings. One manifestation of 
this is the desire, at lower levels of the 
system, to see the big picture and, at 
higher fevels, to evaluate the raw data. 
Information models in higher-level 
analyst’s memories ‘sometimes made 
explicit in material form) occasionaily 
contain references to different 
viewpoints experienced in different 
work sottings. Nevertheless, there are 
as yet many unexplored relationships 
between arrangements for aggregating 
Gata and concepts, and the use of 
explicit information models. 


- 7-6 - 








Sle am eae i ot le 





a ae ne 











8. IMPLICATIONS OF FINDINGS 


No claim is made that ali of the implica- 
tions of this study’s findings have been 
noted. None of the Implications found 
have been evaluated in the present 
project, since such evaluation should be 
premised on the successful validation 
of the cognitive modei of analytic 
activities. Implications that suggested 
themselves to the project team are 
presented primarily as questicns for 
which answers might be found either 
within existing organizational expertise 
or by new Investigations. Some possi- 
ble Implications for a nunber of areas of 
management concern are discussed in 
the foliowing paragraphs: 


8.1 Analytic Accuracy 


The strongest implication of the study 
findings Is judged to be the possible 
leverages for improving analytic accu- 
racy that might be gained by studying 
memory modification sycies In the Indi- 
vidual and team contexts of analytic 
work settings. The fundamental goal 
toward which all efforts at improving 
intelligence analysis are finally aimed Is 
improving the accuracy and quality of 
interpretive products. improvements 
can result from factors such as pro- 
gress in management philosophies and 
techniques, advanced systems for sup- 
port of analyst’s memory requirements 
and for complex judgmental tasks, 
Improved arrangements for performance 
feedback, more accurately directed 
training, improved selection and career 
management, and better data to inter- 
pret. Underlying all such improvenents 
will still be the Indispensable high-grade 
performance of the analyst’s memory, 
and governing the performance of the 
analyst’s memory will be the memory 
modificaticn cycle depicted in the 
model. 


it should be possible to determine to 
what extert efforts to develop aids to 
memory suggested by the model, such 
as examining expectations, performing 
deeper processing, sharing rehearsal 
experiences, reviewing earlier records, 
and refocusing attention under load can 
be helpful In improving the memory per- 
formances of analysts. If such alds are 
found helpful, what ere the implications 
for training the managers of analytic 
teams, for designing memory support 
alds for analysts, for providing perfor- 
mance feedback arrangements, and for 
training analysts? Can Interpretive bias 
factors be pradicted !n practica! situa- 
tions? 


8.2 Management of Analytic Work. 


Next to the effective perform nce of 
the analyst’s memory, the most critical 
element for improved analytic perfor- 
mance appears to be insightful and 
effective management for analysts. 
Many studies in the organizational and 
management fields Indicate that the 
beneficial effects from technical sup- 
port improvements, improved feedback, 
training, and selection can be coun- 
teractad by some management orienta- 
tions. Conversely, management that Is 
insightful about factors affecting spe- 
clailzed organizational and _ individual 
performance may extemporize many 
desirable arrangements and procedures. 


Assuming that various parts of the find- 
ings of thia study are validated, how 
important Is having knowledge of the 
findings for managers of different types 
cf analytic work? What management 
approaches and practices for various 
circumstances are implied by tha 
model? Of particular Interest are 
memory management techniques, fac- 
tors in. using team memory, and safe- 
guards agalnst decision pressure. 
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8.3 System Supports for Analytic 
Functions 


Much Is already known about the use- 
fulness of various systym supports for 
analytic work, and it is clear that 
modern intelligence systems cannot 
hope to perform all the functions 
required of them without carefully 
planned and designed automated sup- 
ports. The general problems  ,roviding 
non-obtrusive but active mw.nory and 
judgmental supports for analysts were 
alluded to eariler. The recent history of 
developmental research efforts for 
automated analytic alds includes con- 
tinuing efforts to provide not only con- 
ventional automated support for data 
and niessage file:, but semi-automatic 
messaye handling and other automation 
almeri at forming and maintaining 
syotsm-based versions of the concep- 
tual nodels (end Implied information 
models) used ‘y analysts. A number of 
questions rega‘ding such supports are 
prompted by the present study findings. 


Static versions of many conceptual and 
Information models currentty exist in 
documented form (e.g., Order of Battie, 
intelligence Preparation of the Battle- 
fleid). How will dynamically supported 
versions of such externalized models 
affect the expectations of analysts? 
In what ways might the models serve as 
armatures for team analyses of inter- 
pretive disparities in problematic situa- 
tions? in such uses, under what condl- 
tions will they: cause Interference; 
clarity analytic alternatives; support or 
curtall productive hypothesis genera- 
tion; focus premature convergence on 
inaccurate interpretations; speed 
correct interpretations; accelerate 
recognition of anticipated events; delay 
recognition of marginally unusual 
events; serve as high-capacity formats 
for transmitting accurate infcrmation; 


serve as high-capacity formats for 
transmitting somewhat inaccurate infor- 
mation? 


Such questions become even more sig- 
nificant in tight of the fact that there 
presently exist concepts and working 
models for various advanced, experi- 
mental, computer-based facilities for 
conducting team judgment prosesses 
via networks of CRT terminals. Team 
communications can be cconstra’ned to 
any desired pattern through such facill- 
ties, and computer information store: 
and graphic capabilities can combine to 
allow members to form and display their 
individual hypotheses to one ancther in 
vivid ways and to overlay their va;’ous 


’ offerings to facilitate ccmpariscns. 


8.4 Performance Fes dback Arrange- 
ments 4 


f 

Is there something +0 be jearned from 
discarded interprecationr?? Post hoc 
analyses of inteligen:;, lapses that 
reach public awaruess sometimes 
include corollary "! told you so” 
material. There is no presenity feasible 
way to save discarded asiternative 
Interpretations on a largs scale, but it 
seems likely that thase Interpretations 
would sometimes have proven more 
accurate than the-‘nes chosen for use. 
Only large-scale inaccuracies on impor- 
tant events are iikely to prompt post 
hoc inquiries, with the result that 
potentially superior but unused every- 
day analytic performancos go unno- 
ticed. 


Yet, the cognitive model suggests that 
more can be gained by focusitig on com- 
parative degrees of success than upon 
scattered instances of highly notice- 
able faliure. Deep cognitive-processing 
rehearsals of analytic failures. will instill 
highly acceusibie memory contents © 
about what not to do, which can be 
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very Important. Nevertheless, such Inhi- 
bitory contenta suggest t.e proper 
ways to proceed only on a default 
basis (by exclusion). A rapid and effec- 
tive response is more likely to be gen- 
erated by accessing memory materials 
related to comparative successes. 


Can the analyst profit equally from 
negative and positive memory exem- 
plars that "fit" a certain eituation? it is 
worth recalling that the cognitive medel 
indicates that the individual is not free 
to choose what will be recalled in a 
given situation: menory access func- 
tions are mestly automatic and outside 
of awareness. What will emerge first 
from memory is what has been pro- 
cessed most frequently and deeply. 
Since there are many more ways to do 
a thing wrong than to do it right, there 
is ample opportunity to load memory 
with detour signs rather than pcsitive 
directional poiniers. 


Regarding feedback arrangements from 
a costs/benefits point of view, part of 
the massive ADP support anticipated for 
analytic activities of the future might 
prove to be used effectively for storing 
generated alternative interpretations 
and automatically comparing them with 
unfolding events. 


8.6 Training for Analytic Work 


The atudy findings Indicate two main 
points for training: 


1. It is essential to consider the 
analyst's detailed training require- 
ments from a systematic viewpoint 
ot required memory contents and 
required memory functioning. — In 
much successful analytic work, a 
wider range of memory contents 
are used than superficially “meets 
the eye." 


2. Having once ilearnec something 
does not necessarily mean that it 
will be appropriately accessible 
from memory when needed. The 
memory modification cycle of the 
model shows that oa filtering and 
consolidation buildup perlod is 
required, in which earlier learnings 
are refreshed and configured to be 
properly accessible by cues from 
the concrete analytic situation of 
the present. 


Moreover, success of the bulldup 
process is not fully uader aware 
volitional control of the analyst. The 
memory modification cycle mechan- 
isms of flitering, consolidation, and 
interference will operate outside 
awareness during the buildup 
period. Efforts must therefore be 
made to channel the resuits of 
these mechaniams in desired direc- 
tions. 


8.6 Selection and career manage- 
ment 


The analysts’ self-report image profile 
presented in this report was gleanec' 
mostly from successful experieiced 
anulysts and should be given serious 
consideration as providing some gul- 
dance for selection § criterla for 
analysts. This is especially true since 
some personne! selection studies have 
shown self-report assessments to have 
comparatively gocd validity for some 
kinds of occupatiois. 


Although the study results provide few 
clear Indications for the more technical 
aspects of selection procedures, it 
seems apparent that potertial an:jysts 
must be selected in terms of demon- 
strated conceptuel abilities, the abso- 
lute leveis required depending upon the 
individual’s (realistic) future aspirations 
for advancement to work settings 
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higher in the analytic continuum | For 
many meiern analytic sattings, “harch 

science or technology interests apper.. 

very desirable. For others, a stronger’ 

social and politica’ science orientation ¥ 

fe needed. Except for assumed career 
termination in the lowest “end-of-the- 

pipe" scurce production work sattings, “ 
Gemonstrated »zal success in complet- 

ing high school and indicated capacity 

te do at Jeast begitining-level coliege 

work ls probably essential. 


interest in military science and related 
lesvas is not an entry-level require- 
ment, but early clear signs of voluntary 
erczwing professionel interest in such 
matters should be a prerequisite for 
tagging candidates for advancement 
and rotation to cifferent and higher 
&ot!e within the analytic continuum. 


The successfid analyst’s orientation 
teward ambiguity is at present an open 
lesue. Toleresice for ambiguity is essen- fe ‘ 

3 ‘ 





tial to the analyst In dealing comfortebly 

with sparse and equlvoca! data pat- + 
terns associated with snatyti: work. On 
the other hand, a vigorous natural \ 
interast in reducing ambiguity also \ 
appeers important. This aspect of tha =| 4 
analyst’s managesvent and reworking of — ‘ 
internal memory contents appears to be 
& productive topic for investigations, 
using tha concept of the contents 
modification cycle presented in this 
report. 
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